Perturbation biology: inferring signaling networks in cellular systems

Benchmarking foundation cell models for post-perturbation RNA-seq prediction

Accurately predicting cellular responses to perturbations is essential for understanding cell behaviour in both healthy and diseased states. While perturbation data is ideal for building such predictive models, its availability is considerably lower than baseline (non-perturbed) cellular data. To address this limitation, several foundation cell models have been developed using large-scale single-cell gene expression data. These models are fine-tuned after pre-training for specific tasks, such as predicting post-perturbation gene expression profiles, and are considered state-of-the-art for these problems. However, proper benchmarking of these models remains an unsolved challenge. In this study, we benchmarked two recently published foundation models, scGPT and scFoundation, against baseline models. Surprisingly, we found that even the simplest baseline model-taking the mean of training examples-outperformed scGPT and scFoundation. Furthermore, basic machine learning models that incorporate biologically meaningful features outperformed scGPT by a large margin. Additionally, we identified that the current Perturb-Seq benchmark datasets exhibit low perturbation-specific variance, making them suboptimal for evaluating such models. Our results highlight important limitations in current benchmarking approaches and provide insights into more effectively evaluating post-perturbation gene expression prediction models.

AUC-PR is a More Informative Metric for Assessing the Biological Relevance of In Silico Cellular Perturbation Prediction Models

In silico perturbation models, computational methods which can predict cellular responses to perturbations, present an opportunity to reduce the need for costly and time-intensive in vitro experiments. Many recently proposed models predict high-dimensional cellular responses, such as gene or protein expression to perturbations such as gene knockout or drugs. However, evaluating in silico performance has largely relied on metrics such asR 2 , which assess overall prediction accuracy but fail to capture biologically significant outcomes like the identification of differentially expressed genes. In this study, we present a novel evaluation framework that introduces the AUC-PR metric to assess the precision and recall of DE gene predictions. By applying this framework to both single-cell and pseudo-bulked datasets, we systematically benchmark simple and advanced computational models. Our results highlight a significant discrepancy betweenR 2 and AUC-PR, with models achieving highR 2 values but struggling to identify Differentially expressed genes accurately, as reflected in their low AUC-PR values. This finding underscores the limitations of traditional evaluation metrics and the importance of biologically relevant assessments. Our framework provides a more comprehensive understanding of model capabilities, advancing the application of computational approaches in cellular perturbation research.

Machine learning to dissect perturbations in complex cellular systems

Understanding the responses of biological systems to various perturbations, such as genetic, chemical, or environmental challenges, is essential for reconstructing causal network models. Emerging single-cell technologies have become instrumental in elucidating cell states and phenotypes and they have been used in combination with genetic screening. Recent advances in machine learning and artificial intelligence architectures have stimulated the development of computational tools for modeling perturbations and the response to compounds. This study outlined core principles underpinning perturbation analysis and discussed the methodologies and analytical frameworks used to decode drug and genetic perturbation responses, complex multicellular interactions, and network dynamics. The current tools used for various applications were overviewed. These developments hold great promise for improving drug development and personalized medicine. Foundation models and perturbation cell and tissue atlases offer immense potential for advancing our understanding of cellular behavior and disease mechanisms.

Mathematical models of intercellular signaling in breast cancer

BACKGROUND AND OBJECTIVES

The development and regulation of healthy and cancerous breast tissue is guided by communication between cells. Diverse signals are exchanged between cancer cells and non-cancerous cells of the tumor microenvironment (TME), influencing all stages of tumor progression. Mathematical models are essential for understanding how this complex network determines cancer progression and the effectiveness of treatment.

METHODOLOGY

We reviewed the current dynamical mathematical models of intercellular signaling in breast cancer, examining models with cancer cells only, fibroblasts, endothelial cells, macrophages and the immune system as whole. We categorized the goals and complexity of these models, to highlight how they can explain many features of cancer emergence and progression.

RESULTS

We found that dynamical models of intercellular signaling can elucidate tissue-level dysregulation in cancer by explaining: i) maintenance of non-heritable intratumor phenotypic heterogeneity, ii) transitions between tumor dormancy and accelerated invasive growth, iii) stromal support of tumor vascularization and growth factor enrichment and iv) suppression of immune infiltration and cancer surveillance. These models also provide a framework to propose novel TME-targeting treatment strategies. However, most models were focused on a highly selected and small set of signaling interactions between a few cell types, and their translational applicability were severely limited by the availability of tumor-specific data for personalized model calibration.

CONCLUSIONS AND IMPLICATIONS

Mathematical models of breast cancer have many challenges and opportunities to incorporate signaling. The four key challenges are: 1) finding ways to treat signaling networks as a context-dependent language that incorporates non-linear and non-additive responses, 2) identifying the key cell phenotypes that signals control and understanding the feedbacks between signals and phenotype that determine the progression of cancer, (3) estimating parameters of specific patient tumors early in treatment, 4) linking models with novel data collection methods that have single cell and spatial resolution. As our approaches advance, it is our hope that dynamical mathematical models of inter-cellular signaling can play a central role in identifying and testing new treatment strategies as well as forecasting impacts of disease treatment.

AI-driven automated discovery tools reveal diverse behavioral competencies of biological networks

Many applications in biomedicine and synthetic bioengineering rely on understanding, mapping, predicting, and controlling the complex behavior of chemical and genetic networks. The emerging field of diverse intelligence investigates the problem-solving capacities of unconventional agents. However, few quantitative tools exist for exploring the competencies of non-conventional systems. Here, we view gene regulatory networks (GRNs) as agents navigating a problem space and develop automated tools to map the robust goal states GRNs can reach despite perturbations. Our contributions include: (1) Adapting curiosity-driven exploration algorithms from AI to discover the range of reachable goal states of GRNs, and (2) Proposing empirical tests inspired by behaviorist approaches to assess their navigation competencies. Our data shows that models inferred from biological data can reach a wide spectrum of steady states, exhibiting various competencies in physiological network dynamics without requiring structural changes in network properties or connectivity. We also explore the applicability of these 'behavioral catalogs' for comparing evolved competencies across biological networks, for designing drug interventions in biomedical contexts and synthetic gene networks for bioengineering. These tools and the emphasis on behavior-shaping open new paths for efficiently exploring the complex behavior of biological networks. For the interactive version of this paper, please visit https://developmentalsystems.org/curious-exploration-of-grn-competencies.

AI-empowered perturbation proteomics for complex biological systems

The insufficient availability of comprehensive protein-level perturbation data is impeding the widespread adoption of systems biology. In this perspective, we introduce the rationale, essentiality, and practicality of perturbation proteomics. Biological systems are perturbed with diverse biological, chemical, and/or physical factors, followed by proteomic measurements at various levels, including changes in protein expression and turnover, post-translational modifications, protein interactions, transport, and localization, along with phenotypic data. Computational models, employing traditional machine learning or deep learning, identify or predict perturbation responses, mechanisms of action, and protein functions, aiding in therapy selection, compound design, and efficient experiment design. We propose to outline a generic PMMP (perturbation, measurement, modeling to prediction) pipeline and build foundation models or other suitable mathematical models based on large-scale perturbation proteomic data. Finally, we contrast modeling between artificially and naturally perturbed systems and highlight the importance of perturbation proteomics for advancing our understanding and predictive modeling of biological systems.

Mass spectrometry-based proteomic approaches for salivary protein biomarkers discovery and dental caries diagnosis: A critical review

Dental caries is a multifactorial chronic disease resulting from the intricate interplay among acid-generating bacteria, fermentable carbohydrates, and several host factors such as saliva. Saliva comprises several proteins which could be utilized as biomarkers for caries prevention, diagnosis, and prognosis. Mass spectrometry-based salivary proteomics approaches, owing to their sensitivity, provide the opportunity to investigate and unveil crucial cariogenic pathogen activity and host indicators and may demonstrate clinically relevant biomarkers to improve caries diagnosis and management. The present review outlines the published literature of human clinical proteomics investigations on caries and extensively elucidates frequently reported salivary proteins as biomarkers. This review also discusses important aspects while designing an experimental proteomics workflow. The protein-protein interactions and the clinical relevance of salivary proteins as biomarkers for caries, together with uninvestigated domains of the discipline are also discussed critically.

Cell State Transition Models Stratify Breast Cancer Cell Phenotypes and Reveal New Therapeutic Targets

Understanding signaling patterns of transformation and controlling cell phenotypes is a challenge of current biology. Here we applied a cell State Transition Assessment and Regulation (cSTAR) approach to a perturbation dataset of single cell phosphoproteomic patterns of multiple breast cancer (BC) and normal breast tissue-derived cell lines. Following a separation of luminal, basal, and normal cell states, we identified signaling nodes within core control networks, delineated causal connections, and determined the primary drivers underlying oncogenic transformation and transitions across distinct BC subtypes. Whereas cell lines within the same BC subtype have different mutational and expression profiles, the architecture of the core network was similar for all luminal BC cells, and mTOR was a main oncogenic driver. In contrast, core networks of basal BC were heterogeneous and segregated into roughly four major subclasses with distinct oncogenic and BC subtype drivers. Likewise, normal breast tissue cells were separated into two different subclasses. Based on the data and quantified network topologies, we derived mechanistic cSTAR models that serve as digital cell twins and allow the deliberate control of cell movements within a Waddington landscape across different cell states. These cSTAR models suggested strategies of normalizing phosphorylation networks of BC cell lines using small molecule inhibitors.

A proteomic landscape of pharmacologic perturbations for functional relevance

Pharmacological perturbation studies based on protein-level signatures are fundamental for drug discovery. In the present study, we used a mass spectrometry (MS)-based proteomic platform to profile the whole proteome of the breast cancer MCF7 cell line under stress induced by 78 bioactive compounds. The integrated analysis of perturbed signal abundance revealed the connectivity between phenotypic behaviors and molecular features in cancer cells. Our data showed functional relevance in exploring the novel pharmacological activity of phenolic xanthohumol, as well as the noncanonical targets of clinically approved tamoxifen, lovastatin, and their derivatives. Furthermore, the rational design of synergistic inhibition using a combination of histone methyltransferase and topoisomerase was identified based on their complementary drug fingerprints. This study provides rich resources for the proteomic landscape of drug responses for precision therapeutic medicine.

Reversing pathological cell states: the road less travelled can extend the therapeutic horizon

Acquisition of omics data advances at a formidable pace. Yet, our ability to utilize these data to control cell phenotypes and design interventions that reverse pathological states lags behind. Here, we posit that cell states are determined by core networks that control cell-wide networks. To steer cell fate decisions, core networks connecting genotype to phenotype must be reconstructed and understood. A recent method, cell state transition assessment and regulation (cSTAR), applies perturbation biology to quantify causal connections and mechanistically models how core networks influence cell phenotypes. cSTAR models are akin to digital cell twins enabling us to purposefully convert pathological states back to physiologically normal states. While this capability has a range of applications, here we discuss reverting oncogenic transformation.

Constructing maps between distinct cell fates and parametric conditions by systematic perturbations

MOTIVATION

Cell fate transitions are common in many developmental processes. Therefore, identifying the mechanisms behind them is crucial. Traditionally, due to complexity of networks and existence of plenty of kinetic parameters, dynamical analysis of biomolecular networks can only be performed by simultaneously perturbing a small number of parameters. Although many efforts have focused on how cell states change under specific perturbations, conversely, how to infer parametric conditions underlying distinct cell fates by systematic perturbations is less clear and needs to be further investigated.

RESULTS

In this article, we present a general computational method by integrating systematic perturbations, unsupervised clustering, principal component analysis, and fitting analysis. The method can be used to to construct maps between distinct cell fates and parametric conditions by systematic perturbations. In particular, there are no needs of accurate parameter measurements and occurrence of bifurcations to establish the maps. To validate feasibility and inference performance of the method, we use toggle switch, inner cell mass, and epithelial mesenchymal transition as model systems to show how the maps are constructed and how system parameters encode essential information on cell fates. The maps tell us how systematic perturbations drive cell fate decisions and transitions, and allow us to purposefully predict, manipulate, and even control cell states. The approach is especially helpful in understanding crucial roles of certain parameter combinations during fate transitions. We hope that the approach can provide us valuable information on parametric or perturbation conditions so some specific targets, e.g. directional differentiation, can be realized.

AVAILABILITY AND IMPLEMENTATION

No public data are used. The data we used are generated by randomly chosen values of model parameters in certain ranges, and the corresponding parameters are already attached in supplementary materials.

Understanding and applying biological resilience, from genes to ecosystems

The natural world is under unprecedented and accelerating pressure. Much work on understanding resilience to local and global environmental change has, so far, focussed on ecosystems. However, understanding a system's behaviour requires knowledge of its component parts and their interactions. Here we call for increased efforts to understand 'biological resilience', or the processes that enable components across biological levels, from genes to communities, to resist or recover from perturbations. Although ecologists and evolutionary biologists have the tool-boxes to examine form and function, efforts to integrate this knowledge across biological levels and take advantage of big data (e.g. ecological and genomic) are only just beginning. We argue that combining eco-evolutionary knowledge with ecosystem-level concepts of resilience will provide the mechanistic basis necessary to improve management of human, natural and agricultural ecosystems, and outline some of the challenges in achieving an understanding of biological resilience.

Evolutionary Stability of Small Molecular Regulatory Networks That Exhibit Near-Perfect Adaptation

Large-scale protein regulatory networks, such as signal transduction systems, contain small-scale modules ('motifs') that carry out specific dynamical functions. Systematic characterization of the properties of small network motifs is therefore of great interest to molecular systems biologists. We simulate a generic model of three-node motifs in search of near-perfect adaptation, the property that a system responds transiently to a change in an environmental signal and then returns near-perfectly to its pre-signal state (even in the continued presence of the signal). Using an evolutionary algorithm, we search the parameter space of these generic motifs for network topologies that score well on a pre-defined measure of near-perfect adaptation. We find many high-scoring parameter sets across a variety of three-node topologies. Of all possibilities, the highest scoring topologies contain incoherent feed-forward loops (IFFLs), and these topologies are evolutionarily stable in the sense that, under 'macro-mutations' that alter the topology of a network, the IFFL motif is consistently maintained. Topologies that rely on negative feedback loops with buffering (NFLBs) are also high-scoring; however, they are not evolutionarily stable in the sense that, under macro-mutations, they tend to evolve an IFFL motif and may-or may not-lose the NFLB motif.

Exploring and Learning the Universe of Protein Allostery Using Artificial Intelligence Augmented Biophysical and Computational Approaches

Allosteric mechanisms are commonly employed regulatory tools used by proteins to orchestrate complex biochemical processes and control communications in cells. The quantitative understanding and characterization of allosteric molecular events are among major challenges in modern biology and require integration of innovative computational experimental approaches to obtain atomistic-level knowledge of the allosteric states, interactions, and dynamic conformational landscapes. The growing body of computational and experimental studies empowered by emerging artificial intelligence (AI) technologies has opened up new paradigms for exploring and learning the universe of protein allostery from first principles. In this review we analyze recent developments in high-throughput deep mutational scanning of allosteric protein functions; applications and latest adaptations of Alpha-fold structural prediction methods for studies of protein dynamics and allostery; new frontiers in integrating machine learning and enhanced sampling techniques for characterization of allostery; and recent advances in structural biology approaches for studies of allosteric systems. We also highlight recent computational and experimental studies of the SARS-CoV-2 spike (S) proteins revealing an important and often hidden role of allosteric regulation driving functional conformational changes, binding interactions with the host receptor, and mutational escape mechanisms of S proteins which are critical for viral infection. We conclude with a summary and outlook of future directions suggesting that AI-augmented biophysical and computer simulation approaches are beginning to transform studies of protein allostery toward systematic characterization of allosteric landscapes, hidden allosteric states, and mechanisms which may bring about a new revolution in molecular biology and drug discovery.

Network inference from perturbation time course data

Networks underlie much of biology from subcellular to ecological scales. Yet, understanding what experimental data are needed and how to use them for unambiguously identifying the structure of even small networks remains a broad challenge. Here, we integrate a dynamic least squares framework into established modular response analysis (DL-MRA), that specifies sufficient experimental perturbation time course data to robustly infer arbitrary two and three node networks. DL-MRA considers important network properties that current methods often struggle to capture: (i) edge sign and directionality; (ii) cycles with feedback or feedforward loops including self-regulation; (iii) dynamic network behavior; (iv) edges external to the network; and (v) robust performance with experimental noise. We evaluate the performance of and the extent to which the approach applies to cell state transition networks, intracellular signaling networks, and gene regulatory networks. Although signaling networks are often an application of network reconstruction methods, the results suggest that only under quite restricted conditions can they be robustly inferred. For gene regulatory networks, the results suggest that incomplete knockdown is often more informative than full knockout perturbation, which may change experimental strategies for gene regulatory network reconstruction. Overall, the results give a rational basis to experimental data requirements for network reconstruction and can be applied to any such problem where perturbation time course experiments are possible.

Parallelization with Dual-Trap Single-Column Configuration Maximizes Throughput of Proteomic Analysis

Proteomic analysis on the scale that captures population and biological heterogeneity over hundreds to thousands of samples requires rapid mass spectrometry methods, which maximize instrument utilization (IU) and proteome coverage while maintaining precise and reproducible quantification. To achieve this, a short liquid chromatography gradient paired to rapid mass spectrometry data acquisition can be used to reproducibly quantify a moderate set of analytes. High-throughput profiling at a limited depth is becoming an increasingly utilized strategy for tackling large sample sets but the time spent on loading the sample, flushing the column(s), and re-equilibrating the system reduces the ratio of meaningful data acquired to total operation time and IU. The dual-trap single-column configuration (DTSC) presented here maximizes IU in rapid analysis (15 min per sample) of blood and cell lysates by parallelizing trap column cleaning and sample loading and desalting with the analysis of the previous sample. We achieved 90% IU in low microflow (9.5 μL/min) analysis of blood while reproducibly quantifying 300-400 proteins and over 6000 precursor ions. The same IU was achieved for cell lysates and over 4000 proteins (3000 at CV below 20%) and 40,000 precursor ions were quantified at a rate of 15 min/sample. Thus, DTSC enables high-throughput epidemiological blood-based biomarker cohort studies and cell-based perturbation screening.

Current State and Challenges of the Global Outcomes of Dental Caries Research in the Meta-Omics Era

Despite significant healthcare advances in the 21st century, the exact etiology of dental caries remains unsolved. The past two decades have witnessed a tremendous growth in our understanding of dental caries amid the advent of revolutionary omics technologies. Accordingly, a consensus has been reached that dental caries is a community-scale metabolic disorder, and its etiology is beyond a single causative organism. This conclusion was based on a variety of microbiome studies following the flow of information along the central dogma of biology from genomic data to the end products of metabolism. These studies were facilitated by the unprecedented growth of the next- generation sequencing tools and omics techniques, such as metagenomics and metatranscriptomics, to estimate the community composition of oral microbiome and its functional potential. Furthermore, the rapidly evolving proteomics and metabolomics platforms, including nuclear magnetic resonance spectroscopy and/or mass spectrometry coupled with chromatography, have enabled precise quantification of the translational outcomes. Although the majority supports 'conserved functional changes' as indicators of dysbiosis, it remains unclear how caries dynamics impact the microbiota functions and vice versa, over the course of disease onset and progression. What compounds the situation is the host-microbiota crosstalk. Genome-wide association studies have been undertaken to elucidate the interaction of host genetic variation with the microbiome. However, these studies are challenged by the complex interaction of host genetics and environmental factors. All these complementary approaches need to be orchestrated to capture the key players in this multifactorial disease. Herein, we critically review the milestones in caries research focusing on the state-of-art singular and integrative omics studies, supplemented with a bibliographic network analysis to address the oral microbiome, the host factors, and their interactions. Additionally, we highlight gaps in the dental literature and shed light on critical future research questions and study designs that could unravel the complexities of dental caries, the most globally widespread disease.

Two heads are better than one: current landscape of integrating QSP and machine learning : An ISoP QSP SIG white paper by the working group on the integration of quantitative systems pharmacology and machine learning

Quantitative systems pharmacology (QSP) modeling is applied to address essential questions in drug development, such as the mechanism of action of a therapeutic agent and the progression of disease. Meanwhile, machine learning (ML) approaches also contribute to answering these questions via the analysis of multi-layer 'omics' data such as gene expression, proteomics, metabolomics, and high-throughput imaging. Furthermore, ML approaches can also be applied to aspects of QSP modeling. Both approaches are powerful tools and there is considerable interest in integrating QSP modeling and ML. So far, a few successful implementations have been carried out from which we have learned about how each approach can overcome unique limitations of the other. The QSP + ML working group of the International Society of Pharmacometrics QSP Special Interest Group was convened in September, 2019 to identify and begin realizing new opportunities in QSP and ML integration. The working group, which comprises 21 members representing 18 academic and industry organizations, has identified four categories of current research activity which will be described herein together with case studies of applications to drug development decision making. The working group also concluded that the integration of QSP and ML is still in its early stages of moving from evaluating available technical tools to building case studies. This paper reports on this fast-moving field and serves as a foundation for future codification of best practices.

Can Systems Biology Advance Clinical Precision Oncology?

Precision oncology is perceived as a way forward to treat individual cancer patients. However, knowing particular cancer mutations is not enough for optimal therapeutic treatment, because cancer genotype-phenotype relationships are nonlinear and dynamic. Systems biology studies the biological processes at the systems' level, using an array of techniques, ranging from statistical methods to network reconstruction and analysis, to mathematical modeling. Its goal is to reconstruct the complex and often counterintuitive dynamic behavior of biological systems and quantitatively predict their responses to environmental perturbations. In this paper, we review the impact of systems biology on precision oncology. We show examples of how the analysis of signal transduction networks allows to dissect resistance to targeted therapies and inform the choice of combinations of targeted drugs based on tumor molecular alterations. Patient-specific biomarkers based on dynamical models of signaling networks can have a greater prognostic value than conventional biomarkers. These examples support systems biology models as valuable tools to advance clinical and translational oncological research.

Molecular response to PARP1 inhibition in ovarian cancer cells as determined by mass spectrometry based proteomics

BACKGROUND

Poly (ADP)-ribose polymerase (PARP) inhibitors have entered routine clinical practice for the treatment of high-grade serous ovarian cancer (HGSOC), yet the molecular mechanisms underlying treatment response to PARP1 inhibition (PARP1i) are not fully understood.

METHODS

Here, we used unbiased mass spectrometry based proteomics with data-driven protein network analysis to systematically characterize how HGSOC cells respond to PARP1i treatment.

RESULTS

We found that PARP1i leads to pronounced proteomic changes in a diverse set of cellular processes in HGSOC cancer cells, consistent with transcript changes in an independent perturbation dataset. We interpret decreases in the levels of the pro-proliferative transcription factors SP1 and β-catenin and in growth factor signaling as reflecting the anti-proliferative effect of PARP1i; and the strong activation of pro-survival processes NF-κB signaling and lipid metabolism as PARPi-induced adaptive resistance mechanisms. Based on these observations, we nominate several protein targets for therapeutic inhibition in combination with PARP1i. When tested experimentally, the combination of PARPi with an inhibitor of fatty acid synthase (TVB-2640) has a 3-fold synergistic effect and is therefore of particular pre-clinical interest.

CONCLUSION

Our study improves the current understanding of PARP1 function, highlights the potential that the anti-tumor efficacy of PARP1i may not only rely on DNA damage repair mechanisms and informs on the rational design of PARP1i combination therapies in ovarian cancer.

Identifying the combinatorial control of signal-dependent transcription factors

The effectiveness of immune responses depends on the precision of stimulus-responsive gene expression programs. Cells specify which genes to express by activating stimulus-specific combinations of stimulus-induced transcription factors (TFs). Their activities are decoded by a gene regulatory strategy (GRS) associated with each response gene. Here, we examined whether the GRSs of target genes may be inferred from stimulus-response (input-output) datasets, which remains an unresolved model-identifiability challenge. We developed a mechanistic modeling framework and computational workflow to determine the identifiability of all possible combinations of synergistic (AND) or non-synergistic (OR) GRSs involving three transcription factors. Considering different sets of perturbations for stimulus-response studies, we found that two thirds of GRSs are easily distinguishable but that substantially more quantitative data is required to distinguish the remaining third. To enhance the accuracy of the inference with timecourse experimental data, we developed an advanced error model that avoids error overestimates by distinguishing between value and temporal error. Incorporating this error model into a Bayesian framework, we show that GRS models can be identified for individual genes by considering multiple datasets. Our analysis rationalizes the allocation of experimental resources by identifying most informative TF stimulation conditions. Applying this computational workflow to experimental data of immune response genes in macrophages, we found that a much greater fraction of genes are combinatorially controlled than previously reported by considering compensation among transcription factors. Specifically, we revealed that a group of known NFκB target genes may also be regulated by IRF3, which is supported by chromatin immuno-precipitation analysis. Our study provides a computational workflow for designing and interpreting stimulus-response gene expression studies to identify underlying gene regulatory strategies and further a mechanistic understanding.

Expectation propagation on the diluted Bayesian classifier

Efficient feature selection from high-dimensional datasets is a very important challenge in many data-driven fields of science and engineering. We introduce a statistical mechanics inspired strategy that addresses the problem of sparse feature selection in the context of binary classification by leveraging a computational scheme known as expectation propagation (EP). The algorithm is used in order to train a continuous-weights perceptron learning a classification rule from a set of (possibly partly mislabeled) examples provided by a teacher perceptron with diluted continuous weights. We test the method in the Bayes optimal setting under a variety of conditions and compare it to other state-of-the-art algorithms based on message passing and on expectation maximization approximate inference schemes. Overall, our simulations show that EP is a robust and competitive algorithm in terms of variable selection properties, estimation accuracy, and computational complexity, especially when the student perceptron is trained from correlated patterns that prevent other iterative methods from converging. Furthermore, our numerical tests demonstrate that the algorithm is capable of learning online the unknown values of prior parameters, such as the dilution level of the weights of the teacher perceptron and the fraction of mislabeled examples, quite accurately. This is achieved by means of a simple maximum likelihood strategy that consists in minimizing the free energy associated with the EP algorithm.

Causal interactions from proteomic profiles: Molecular data meet pathway knowledge

We present a computational method to infer causal mechanisms in cell biology by analyzing changes in high-throughput proteomic profiles on the background of prior knowledge captured in biochemical reaction knowledge bases. The method mimics a biologist's traditional approach of explaining changes in data using prior knowledge but does this at the scale of hundreds of thousands of reactions. This is a specific example of how to automate scientific reasoning processes and illustrates the power of mapping from experimental data to prior knowledge via logic programming. The identified mechanisms can explain how experimental and physiological perturbations, propagating in a network of reactions, affect cellular responses and their phenotypic consequences. Causal pathway analysis is a powerful and flexible discovery tool for a wide range of cellular profiling data types and biological questions. The automated causation inference tool, as well as the source code, are freely available at http://causalpath.org.

•

CausalPath builds mechanistic models from proteomic profiles

•

It integrates biological pathway models with molecular measurements

•

It supports logical reasoning with post-translational modifications

•

A web server, free software, and a source code are available

Molecular profiling of biological organisms provides us with a great amount of information on cellular differences, but converting it to mechanistic insights is still a very challenging task. A prominent approach is to integrate new measurements with the mechanistic knowledge described in the scientific literature and build a model that is supported by both. Although this can be done in many ways, an adept approach will use the literature knowledge in detail and follow high standards of logical reasoning while integrating the known and the new. This article describes an approach that utilizes the details in human biological pathways to identify pairs of changes with a likely cause-effect relation within. The approach automatically converts comparative proteomic and other molecular profiles into hypotheses of differentially active mechanistic relations that explain how the profiles came to be.

Group Behavior and Emergence of Cancer Drug Resistance

Drug resistance is a major impediment in cancer. Although it is generally thought that acquired drug resistance is due to genetic mutations, emerging evidence indicates that nongenetic mechanisms also play an important role. Resistance emerges through a complex interplay of clonal groups within a heterogeneous tumor and the surrounding microenvironment. Traits such as phenotypic plasticity, intercellular communication, and adaptive stress response, act in concert to ensure survival of intermediate reversible phenotypes, until permanent, resistant clones can emerge. Understanding the role of group behavior, and the underlying nongenetic mechanisms, can lead to more efficacious treatment designs and minimize or delay emergence of resistance.

An Early Stage Researcher's Primer on Systems Medicine Terminology

Background: Systems Medicine is a novel approach to medicine, that is, an interdisciplinary field that considers the human body as a system, composed of multiple parts and of complex relationships at multiple levels, and further integrated into an environment. Exploring Systems Medicine implies understanding and combining concepts coming from diametral different fields, including medicine, biology, statistics, modeling and simulation, and data science. Such heterogeneity leads to semantic issues, which may slow down implementation and fruitful interaction between these highly diverse fields. Methods: In this review, we collect and explain more than100 terms related to Systems Medicine. These include both modeling and data science terms and basic systems medicine terms, along with some synthetic definitions, examples of applications, and lists of relevant references. Results: This glossary aims at being a first aid kit for the Systems Medicine researcher facing an unfamiliar term, where he/she can get a first understanding of them, and, more importantly, examples and references for digging into the topic.

Inferring signaling pathways with probabilistic programming

MOTIVATION

Cells regulate themselves via dizzyingly complex biochemical processes called signaling pathways. These are usually depicted as a network, where nodes represent proteins and edges indicate their influence on each other. In order to understand diseases and therapies at the cellular level, it is crucial to have an accurate understanding of the signaling pathways at work. Since signaling pathways can be modified by disease, the ability to infer signaling pathways from condition- or patient-specific data is highly valuable. A variety of techniques exist for inferring signaling pathways. We build on past works that formulate signaling pathway inference as a Dynamic Bayesian Network structure estimation problem on phosphoproteomic time course data. We take a Bayesian approach, using Markov Chain Monte Carlo to estimate a posterior distribution over possible Dynamic Bayesian Network structures. Our primary contributions are (i) a novel proposal distribution that efficiently samples sparse graphs and (ii) the relaxation of common restrictive modeling assumptions.

RESULTS

We implement our method, named Sparse Signaling Pathway Sampling, in Julia using the Gen probabilistic programming language. Probabilistic programming is a powerful methodology for building statistical models. The resulting code is modular, extensible and legible. The Gen language, in particular, allows us to customize our inference procedure for biological graphs and ensure efficient sampling. We evaluate our algorithm on simulated data and the HPN-DREAM pathway reconstruction challenge, comparing our performance against a variety of baseline methods. Our results demonstrate the vast potential for probabilistic programming, and Gen specifically, for biological network inference.

AVAILABILITY AND IMPLEMENTATION

Find the full codebase at https://github.com/gitter-lab/ssps.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

CellBox: Interpretable Machine Learning for Perturbation Biology with Application to the Design of Cancer Combination Therapy

Systematic perturbation of cells followed by comprehensive measurements of molecular and phenotypic responses provides informative data resources for constructing computational models of cell biology. Models that generalize well beyond training data can be used to identify combinatorial perturbations of potential therapeutic interest. Major challenges for machine learning on large biological datasets are to find global optima in a complex multidimensional space and mechanistically interpret the solutions. To address these challenges, we introduce a hybrid approach that combines explicit mathematical models of cell dynamics with a machine-learning framework, implemented in TensorFlow. We tested the modeling framework on a perturbation-response dataset of a melanoma cell line after drug treatments. The models can be efficiently trained to describe cellular behavior accurately. Even though completely data driven and independent of prior knowledge, the resulting de novo network models recapitulate some known interactions. The approach is readily applicable to various kinetic models of cell biology. A record of this paper's Transparent Peer Review process is included in the Supplemental Information.

Context-specific network modeling identifies new crosstalk in β-adrenergic cardiac hypertrophy

Cardiac hypertrophy is a context-dependent phenomenon wherein a myriad of biochemical and biomechanical factors regulate myocardial growth through a complex large-scale signaling network. Although numerous studies have investigated hypertrophic signaling pathways, less is known about hypertrophy signaling as a whole network and how this network acts in a context-dependent manner. Here, we developed a systematic approach, CLASSED (Context-specific Logic-bASed Signaling nEtwork Development), to revise a large-scale signaling model based on context-specific data and identify main reactions and new crosstalks regulating context-specific response. CLASSED involves four sequential stages with an automated validation module as a core which builds a logic-based ODE model from the interaction graph and outputs the model validation percent. The context-specific model is developed by estimation of default parameters, classified qualitative validation, hybrid Morris-Sobol global sensitivity analysis, and discovery of missing context-dependent crosstalks. Applying this pipeline to our prior-knowledge hypertrophy network with context-specific data revealed key signaling reactions which distinctly regulate cell response to isoproterenol, phenylephrine, angiotensin II and stretch. Furthermore, with CLASSED we developed a context-specific model of β-adrenergic cardiac hypertrophy. The model predicted new crosstalks between calcium/calmodulin-dependent pathways and upstream signaling of Ras in the ISO-specific context. Experiments in cardiomyocytes validated the model’s predictions on the role of CaMKII-Gβγ and CaN-Gβγ interactions in mediating hypertrophic signals in ISO-specific context and revealed a difference in the phosphorylation magnitude and translocation of ERK1/2 between cardiac myocytes and fibroblasts. CLASSED is a systematic approach for developing context-specific large-scale signaling networks, yielding insights into new-found crosstalks in β-adrenergic cardiac hypertrophy.

Pathological cardiac hypertrophy is a disease in which the heart grows abnormally in response to different motivators such as high blood pressure or variations in hormones and growth factors. The shape of the heart after its growth depends on the context in which it grows. Since cell signaling in the cardiac cells plays a key role in the determination of heart shape, a thorough understanding of cardiac cells signaling in each context enlightens the mechanisms which control response of cardiac cells. However, cell signaling in cardiac hypertrophy comprises a complex web of pathways with numerous interactions, and predicting how these interactions control the hypertrophic signal in each context is not achievable by only experiments or general computational models. To address this need, we developed an approach to bring together the experimental data of each context with a signaling network curated from literature to identify the main players of cardiac cells response in each context and attain the context-specific models of cardiac hypertrophy. By utilizing our approach, we identified the main regulators of cardiac hypertrophy in four important contexts. We developed a network model of β-adrenergic cardiac hypertrophy, and predicted and validated new interactions that regulate cardiac cells response in this context.

Large-Scale Characterization of Drug Responses of Clinically Relevant Proteins in Cancer Cell Lines

Perturbation biology is a powerful approach to modeling quantitative cellular behaviors and understanding detailed disease mechanisms. However, large-scale protein response resources of cancer cell lines to perturbations are not available, resulting in a critical knowledge gap. Here we generated and compiled perturbed expression profiles of ∼210 clinically relevant proteins in >12,000 cancer cell line samples in response to ∼170 drug compounds using reverse-phase protein arrays. We show that integrating perturbed protein response signals provides mechanistic insights into drug resistance, increases the predictive power for drug sensitivity, and helps identify effective drug combinations. We build a systematic map of "protein-drug" connectivity and develop a user-friendly data portal for community use. Our study provides a rich resource to investigate the behaviors of cancer cells and the dependencies of treatment responses, thereby enabling a broad range of biomedical applications.

Inferring causal networks of dynamical systems through transient dynamics and perturbation

Inferring causal relations from time series measurements is an ill-posed mathematical problem, where typically an infinite number of potential solutions can reproduce the given data. We explore in depth a strategy to disambiguate between possible underlying causal networks by perturbing the network, where the forcings are either targeted or applied at random. The resulting transient dynamics provide the critical information necessary to infer causality. Two methods are shown to provide accurate causal reconstructions: Granger causality (GC) with perturbations, and our proposed perturbation cascade inference (PCI). Perturbed GC is capable of inferring smaller networks under low coupling strength regimes. Our proposed PCI method demonstrated consistently strong performance in inferring causal relations for small (2-5 node) and large (10-20 node) networks, with both linear and nonlinear dynamics. Thus, the ability to apply a large and diverse set of perturbations to the network is critical for successfully and accurately determining causal relations and disambiguating between various viable networks.

Inferring a network from dynamical signals at its nodes

We give an approximate solution to the difficult inverse problem of inferring the topology of an unknown network from given time-dependent signals at the nodes. For example, we measure signals from individual neurons in the brain, and infer how they are inter-connected. We use Maximum Caliber as an inference principle. The combinatorial challenge of high-dimensional data is handled using two different approximations to the pairwise couplings. We show two proofs of principle: in a nonlinear genetic toggle switch circuit, and in a toy neural network.

A systems biology approach to discovering pathway signaling dysregulation in metastasis

Total metastatic burden is the primary cause of death for many cancer patients. While the process of metastasis has been studied widely, much remains to be understood. Moreover, few agents have been developed that specifically target the major steps of the metastatic cascade. Many individual genes and pathways have been implicated in metastasis but a holistic view of how these interact and cooperate to regulate and execute the process remains somewhat rudimentary. It is unclear whether all of the signaling features that regulate and execute metastasis are yet fully understood. Novel features of a complex system such as metastasis can often be discovered by taking a systems-based approach. We introduce the concepts of systems modeling and define some of the central challenges facing the application of a multidisciplinary systems-based approach to understanding metastasis and finding actionable targets therein. These challenges include appreciating the unique properties of the high-dimensional omics data often used for modeling, limitations in knowledge of the system (metastasis), tumor heterogeneity and sampling bias, and some of the issues key to understanding critical features of molecular signaling in the context of metastasis. We also provide a brief introduction to integrative modeling that focuses on both the nodes and edges of molecular signaling networks. Finally, we offer some observations on future directions as they relate to developing a systems-based model of the metastatic cascade.

Perturbation biology links temporal protein changes to drug responses in a melanoma cell line

Cancer cells have genetic alterations that often directly affect intracellular protein signaling processes allowing them to bypass control mechanisms for cell death, growth and division. Cancer drugs targeting these alterations often work initially, but resistance is common. Combinations of targeted drugs may overcome or prevent resistance, but their selection requires context-specific knowledge of signaling pathways including complex interactions such as feedback loops and crosstalk. To infer quantitative pathway models, we collected a rich dataset on a melanoma cell line: Following perturbation with 54 drug combinations, we measured 124 (phospho-)protein levels and phenotypic response (cell growth, apoptosis) in a time series from 10 minutes to 67 hours. From these data, we trained time-resolved mathematical models that capture molecular interactions and the coupling of molecular levels to cellular phenotype, which in turn reveal the main direct or indirect molecular responses to each drug. Systematic model simulations identified novel combinations of drugs predicted to reduce the survival of melanoma cells, with partial experimental verification. This particular application of perturbation biology demonstrates the potential impact of combining time-resolved data with modeling for the discovery of new combinations of cancer drugs.

Robust network inference using response logic

Motivation

A major challenge in molecular and cellular biology is to map out the regulatory networks of cells. As regulatory interactions can typically not be directly observed experimentally, various computational methods have been proposed to disentangling direct and indirect effects. Most of these rely on assumptions that are rarely met or cannot be adapted to a given context.

Results

We present a network inference method that is based on a simple response logic with minimal presumptions. It requires that we can experimentally observe whether or not some of the system’s components respond to perturbations of some other components, and then identifies the directed networks that most accurately account for the observed propagation of the signal. To cope with the intractable number of possible networks, we developed a logic programming approach that can infer networks of hundreds of nodes, while being robust to noisy, heterogeneous or missing data. This allows to directly integrate prior network knowledge and additional constraints such as sparsity. We systematically benchmark our method on KEGG pathways, and show that it outperforms existing approaches in DREAM3 and DREAM4 challenges. Applied to a novel perturbation dataset on PI3K and MAPK pathways in isogenic models of a colon cancer cell line, it generates plausible network hypotheses that explain distinct sensitivities toward various targeted inhibitors due to different PI3K mutants.

Availability and implementation

A Python/Answer Set Programming implementation can be accessed at github.com/GrossTor/response-logic. Data and analysis scripts are available at github.com/GrossTor/response-logic-projects.

Supplementary information

Supplementary data are available at Bioinformatics online.

Learning signaling networks from combinatorial perturbations by exploiting siRNA off-target effects

Motivation

Perturbation experiments constitute the central means to study cellular networks. Several confounding factors complicate computational modeling of signaling networks from this data. First, the technique of RNA interference (RNAi), designed and commonly used to knock-down specific genes, suffers from off-target effects. As a result, each experiment is a combinatorial perturbation of multiple genes. Second, the perturbations propagate along unknown connections in the signaling network. Once the signal is blocked by perturbation, proteins downstream of the targeted proteins also become inactivated. Finally, all perturbed network members, either directly targeted by the experiment, or by propagation in the network, contribute to the observed effect, either in a positive or negative manner. One of the key questions of computational inference of signaling networks from such data are, how many and what combinations of perturbations are required to uniquely and accurately infer the model?

Results

Here, we introduce an enhanced version of linear effects models (LEMs), which extends the original by accounting for both negative and positive contributions of the perturbed network proteins to the observed phenotype. We prove that the enhanced LEMs are identified from data measured under perturbations of all single, pairs and triplets of network proteins. For small networks of up to five nodes, only perturbations of single and pairs of proteins are required for identifiability. Extensive simulations demonstrate that enhanced LEMs achieve excellent accuracy of parameter estimation and network structure learning, outperforming the previous version on realistic data. LEMs applied to Bartonella henselae infection RNAi screening data identified known interactions between eight nodes of the infection network, confirming high specificity of our model and suggested one new interaction.

Availability and implementation

https://github.com/EwaSzczurek/LEM

Supplementary information

Supplementary data are available at Bioinformatics online.

Data generation and network reconstruction strategies for single cell transcriptomic profiles of CRISPR-mediated gene perturbations

Recent advances in single-cell RNA-sequencing (scRNA-seq) in combination with CRISPR/Cas9 technologies have enabled the development of methods for large-scale perturbation studies with transcriptional readouts. These methods are highly scalable and have the potential to provide a wealth of information on the biological networks that underlie cellular response. Here we discuss how to overcome several key challenges to generate and analyse data for the confident reconstruction of models of the underlying cellular network. Some challenges are generic, and apply to analysing any single-cell transcriptomic data, while others are specific to combined single-cell CRISPR/Cas9 data, in particular barcode swapping, knockdown efficiency, multiplicity of infection and potential confounding factors. We also provide a curated collection of published data sets to aid the development of analysis strategies. Finally, we discuss several network reconstruction approaches, including co-expression networks and Bayesian networks, as well as their limitations, and highlight the potential of Nested Effects Models for network reconstruction from scRNA-seq data. This article is part of a Special Issue entitled: Transcriptional Profiles and Regulatory Gene Networks edited by Dr. Dr. Federico Manuel Giorgi and Dr. Shaun Mahony.

Patient-specific logic models of signaling pathways from screenings on cancer biopsies to prioritize personalized combination therapies

Mechanistic modeling of signaling pathways mediating patient-specific response to therapy can help to unveil resistance mechanisms and improve therapeutic strategies. Yet, creating such models for patients, in particular for solid malignancies, is challenging. A major hurdle to build these models is the limited material available that precludes the generation of large-scale perturbation data. Here, we present an approach that couples ex vivo high-throughput screenings of cancer biopsies using microfluidics with logic-based modeling to generate patient-specific dynamic models of extrinsic and intrinsic apoptosis signaling pathways. We used the resulting models to investigate heterogeneity in pancreatic cancer patients, showing dissimilarities especially in the PI3K-Akt pathway. Variation in model parameters reflected well the different tumor stages. Finally, we used our dynamic models to efficaciously predict new personalized combinatorial treatments. Our results suggest that our combination of microfluidic experiments and mathematical model can be a novel tool toward cancer precision medicine.

Reverse engineering directed gene regulatory networks from transcriptomics and proteomics data of biomining bacterial communities with approximate Bayesian computation and steady-state signalling simulations

BACKGROUND

Network inference is an important aim of systems biology. It enables the transformation of OMICs datasets into biological knowledge. It consists of reverse engineering gene regulatory networks from OMICs data, such as RNAseq or mass spectrometry-based proteomics data, through computational methods. This approach allows to identify signalling pathways involved in specific biological functions. The ability to infer causality in gene regulatory networks, in addition to correlation, is crucial for several modelling approaches and allows targeted control in biotechnology applications.

METHODS

We performed simulations according to the approximate Bayesian computation method, where the core model consisted of a steady-state simulation algorithm used to study gene regulatory networks in systems for which a limited level of details is available. The simulations outcome was compared to experimentally measured transcriptomics and proteomics data through approximate Bayesian computation.

RESULTS

The structure of small gene regulatory networks responsible for the regulation of biological functions involved in biomining were inferred from multi OMICs data of mixed bacterial cultures. Several causal inter- and intraspecies interactions were inferred between genes coding for proteins involved in the biomining process, such as heavy metal transport, DNA damage, replication and repair, and membrane biogenesis. The method also provided indications for the role of several uncharacterized proteins by the inferred connection in their network context.

CONCLUSIONS

The combination of fast algorithms with high-performance computing allowed the simulation of a multitude of gene regulatory networks and their comparison to experimentally measured OMICs data through approximate Bayesian computation, enabling the probabilistic inference of causality in gene regulatory networks of a multispecies bacterial system involved in biomining without need of single-cell or multiple perturbation experiments. This information can be used to influence biological functions and control specific processes in biotechnology applications.

Systems biology and big data in asthma and allergy: recent discoveries and emerging challenges

Asthma is a common condition caused by immune and respiratory dysfunction, and it is often linked to allergy. A systems perspective may prove helpful in unravelling the complexity of asthma and allergy. Our aim is to give an overview of systems biology approaches used in allergy and asthma research. Specifically, we describe recent "omic"-level findings, and examine how these findings have been systematically integrated to generate further insight.Current research suggests that allergy is driven by genetic and epigenetic factors, in concert with environmental factors such as microbiome and diet, leading to early-life disturbance in immunological development and disruption of balance within key immuno-inflammatory pathways. Variation in inherited susceptibility and exposures causes heterogeneity in manifestations of asthma and other allergic diseases. Machine learning approaches are being used to explore this heterogeneity, and to probe the pathophysiological patterns or "endotypes" that correlate with subphenotypes of asthma and allergy. Mathematical models are being built based on genomic, transcriptomic and proteomic data to predict or discriminate disease phenotypes, and to describe the biomolecular networks behind asthma.The use of systems biology in allergy and asthma research is rapidly growing, and has so far yielded fruitful results. However, the scale and multidisciplinary nature of this research means that it is accompanied by new challenges. Ultimately, it is hoped that systems medicine, with its integration of omics data into clinical practice, can pave the way to more precise, personalised and effective management of asthma.

Using machine learning to assess short term causal dependence and infer network links

We introduce and test a general machine-learning-based technique for the inference of short term causal dependence between state variables of an unknown dynamical system from time-series measurements of its state variables. Our technique leverages the results of a machine learning process for short time prediction to achieve our goal. The basic idea is to use the machine learning to estimate the elements of the Jacobian matrix of the dynamical flow along an orbit. The type of machine learning that we employ is reservoir computing. We present numerical tests on link inference of a network of interacting dynamical nodes. It is seen that dynamical noise can greatly enhance the effectiveness of our technique, while observational noise degrades the effectiveness. We believe that the competition between these two opposing types of noise will be the key factor determining the success of causal inference in many of the most important application situations.

Mapping the perturbome network of cellular perturbations

Drug combinations provide effective treatments for diverse diseases, but also represent a major cause of adverse reactions. Currently there is no systematic understanding of how the complex cellular perturbations induced by different drugs influence each other. Here, we introduce a mathematical framework for classifying any interaction between perturbations with high-dimensional effects into 12 interaction types. We apply our framework to a large-scale imaging screen of cell morphology changes induced by diverse drugs and their combination, resulting in a perturbome network of 242 drugs and 1832 interactions. Our analysis of the chemical and biological features of the drugs reveals distinct molecular fingerprints for each interaction type. We find a direct link between drug similarities on the cell morphology level and the distance of their respective protein targets within the cellular interactome of molecular interactions. The interactome distance is also predictive for different types of drug interactions.

Emergent Gene Expression Responses to Drug Combinations Predict Higher-Order Drug Interactions

Effective design of combination therapies requires understanding the changes in cell physiology that result from drug interactions. Here, we show that the genome-wide transcriptional response to combinations of two drugs, measured at a rigorously controlled growth rate, can predict higher-order antagonism with a third drug in Saccharomyces cerevisiae. Using isogrowth profiling, over 90% of the variation in cellular response can be decomposed into three principal components (PCs) that have clear biological interpretations. We demonstrate that the third PC captures emergent transcriptional programs that are dependent on both drugs and can predict antagonism with a third drug targeting the emergent pathway. We further show that emergent gene expression patterns are most pronounced at a drug ratio where the drug interaction is strongest, providing a guideline for future measurements. Our results provide a readily applicable recipe for uncovering emergent responses in other systems and for higher-order drug combinations. A record of this paper's transparent peer review process is included in the Supplemental Information.

Hierarchical optimization for the efficient parametrization of ODE models

Motivation

Mathematical models are nowadays important tools for analyzing dynamics of cellular processes. The unknown model parameters are usually estimated from experimental data. These data often only provide information about the relative changes between conditions, hence, the observables contain scaling parameters. The unknown scaling parameters and corresponding noise parameters have to be inferred along with the dynamic parameters. The nuisance parameters often increase the dimensionality of the estimation problem substantially and cause convergence problems.

Results

In this manuscript, we propose a hierarchical optimization approach for estimating the parameters for ordinary differential equation (ODE) models from relative data. Our approach restructures the optimization problem into an inner and outer subproblem. These subproblems possess lower dimensions than the original optimization problem, and the inner problem can be solved analytically. We evaluated accuracy, robustness and computational efficiency of the hierarchical approach by studying three signaling pathways. The proposed approach achieved better convergence than the standard approach and required a lower computation time. As the hierarchical optimization approach is widely applicable, it provides a powerful alternative to established approaches.

Availability and implementation

The code is included in the MATLAB toolbox PESTO which is available at http://github.com/ICB-DCM/PESTO.

Supplementary information

Supplementary data are available at Bioinformatics online.

Bio-Curation for Cellular Signalling: The KAMI Project

The general question of what constitutes bio-curation for rule-based modelling of cellular signalling is posed. A general approach to the problem is presented, based on rewriting in hierarchies of graphs, together with a specific instantiation of the methodology that addresses our particular bio-curation problem. The current state of the ongoing development of the KAMI bio-curation tool, based on this approach, is outlined along with our plans for future development.

Connecting signaling and metabolic pathways in EGF receptor-mediated oncogenesis of glioblastoma

As malignant transformation requires synchronization of growth-driving signaling (S) and metabolic (M) pathways, defining cancer-specific S-M interconnected networks (SMINs) could lead to better understanding of oncogenic processes. In a systems-biology approach, we developed a mathematical model for SMINs in mutated EGF receptor (EGFRvIII) compared to wild-type EGF receptor (EGFRwt) expressing glioblastoma multiforme (GBM). Starting with experimentally validated human protein-protein interactome data for S-M pathways, and incorporating proteomic data for EGFRvIII and EGFRwt GBM cells and patient transcriptomic data, we designed a dynamic model for EGFR-driven GBM-specific information flow. Key nodes and paths identified by in silico perturbation were validated experimentally when inhibition of signaling pathway proteins altered expression of metabolic proteins as predicted by the model. This demonstrated capacity of the model to identify unknown connections between signaling and metabolic pathways, explain the robustness of oncogenic SMINs, predict drug escape, and assist identification of drug targets and the development of combination therapies.

Complex and highly dynamic interconnected networks allow cancer to take different routes and circumvent chemotherapy. Therefore, understanding these context-specific networks and their dynamics of molecular interactions driven by different oncogenic signaling and metabolic pathways is very much needed to predict drug targets and the effect of therapeutics. We incorporated high-throughput transcriptome and proteome data into mathematical models to deduce properties of cancer cells through systems biology approach. Here we report the development, testing and validation of an integrated systems biology model of information flow between signaling and metabolic pathways to understand the regulation of the interconnection between them in cancer. Our model efficiently identified unique connections and key nodes important in signaling-metabolic information flow. We predicted some potential novel targets before performing actual drug tests. We have successfully applied this model to identify the interconnections altered in the constitutive signaling of the mutated EGFR by comparing EGF-dependent and wild-type EGFR signaling in glioblastoma multiforme.

Network pharmacology modeling identifies synergistic Aurora B and ZAK interaction in triple-negative breast cancer

Cancer cells with heterogeneous mutation landscapes and extensive functional redundancy easily develop resistance to monotherapies by emerging activation of compensating or bypassing pathways. To achieve more effective and sustained clinical responses, synergistic interactions of multiple druggable targets that inhibit redundant cancer survival pathways are often required. Here, we report a systematic polypharmacology strategy to predict, test, and understand the selective drug combinations for MDA-MB-231 triple-negative breast cancer cells. We started by applying our network pharmacology model to predict synergistic drug combinations. Next, by utilizing kinome-wide drug-target profiles and gene expression data, we pinpointed a synergistic target interaction between Aurora B and ZAK kinase inhibition that led to enhanced growth inhibition and cytotoxicity, as validated by combinatorial siRNA, CRISPR/Cas9, and drug combination experiments. The mechanism of such a context-specific target interaction was elucidated using a dynamic simulation of MDA-MB-231 signaling network, suggesting a cross-talk between p53 and p38 pathways. Our results demonstrate the potential of polypharmacological modeling to systematically interrogate target interactions that may lead to clinically actionable and personalized treatment options.

Systems biology: perspectives on multiscale modeling in research on endocrine-related cancers

Drawing on concepts from experimental biology, computer science, informatics, mathematics and statistics, systems biologists integrate data across diverse platforms and scales of time and space to create computational and mathematical models of the integrative, holistic functions of living systems. Endocrine-related cancers are well suited to study from a systems perspective because of the signaling complexities arising from the roles of growth factors, hormones and their receptors as critical regulators of cancer cell biology and from the interactions among cancer cells, normal cells and signaling molecules in the tumor microenvironment. Moreover, growth factors, hormones and their receptors are often effective targets for therapeutic intervention, such as estrogen biosynthesis, estrogen receptors or HER2 in breast cancer and androgen receptors in prostate cancer. Given the complexity underlying the molecular control networks in these cancers, a simple, intuitive understanding of how endocrine-related cancers respond to therapeutic protocols has proved incomplete and unsatisfactory. Systems biology offers an alternative paradigm for understanding these cancers and their treatment. To correctly interpret the results of systems-based studies requires some knowledge of how in silico models are built, and how they are used to describe a system and to predict the effects of perturbations on system function. In this review, we provide a general perspective on the field of cancer systems biology, and we explore some of the advantages, limitations and pitfalls associated with using predictive multiscale modeling to study endocrine-related cancers.

Adapting machine-learning algorithms to design gene circuits

BACKGROUND

Gene circuits are important in many aspects of biology, and perform a wide variety of different functions. For example, some circuits oscillate (e.g. the cell cycle), some are bistable (e.g. as cells differentiate), some respond sharply to environmental signals (e.g. ultrasensitivity), and some pattern multicellular tissues (e.g. Turing's model). Often, one starts from a given circuit, and using simulations, asks what functions it can perform. Here we want to do the opposite: starting from a prescribed function, can we find a circuit that executes this function? Whilst simple in principle, this task is challenging from a computational perspective, since gene circuit models are complex systems with many parameters. In this work, we adapted machine-learning algorithms to significantly accelerate gene circuit discovery.

RESULTS

We use gradient-descent optimization algorithms from machine learning to rapidly screen and design gene circuits. With this approach, we found that we could rapidly design circuits capable of executing a range of different functions, including those that: (1) recapitulate important in vivo phenomena, such as oscillators, and (2) perform complex tasks for synthetic biology, such as counting noisy biological events.

CONCLUSIONS

Our computational pipeline will facilitate the systematic study of natural circuits in a range of contexts, and allow the automatic design of circuits for synthetic biology. Our method can be readily applied to biological networks of any type and size, and is provided as an open-source and easy-to-use python module, GeneNet.

Network structure of the Wisconsin Schizotypy Scales-Short Forms: Examining psychometric network filtering approaches

Schizotypy is a multidimensional construct that provides a useful framework for understanding the etiology, development, and risk for schizophrenia-spectrum disorders. Past research has applied traditional methods, such as factor analysis, to uncovering common dimensions of schizotypy. In the present study, we aimed to advance the construct of schizotypy, measured by the Wisconsin Schizotypy Scales-Short Forms (WSS-SF), beyond this general scope by applying two different psychometric network filtering approaches-the state-of-the-art approach (lasso), which has been employed in previous studies, and an alternative approach (information-filtering networks; IFNs). First, we applied both filtering approaches to two large, independent samples of WSS-SF data (ns = 5,831 and 2,171) and assessed each approach's representation of the WSS-SF's schizotypy construct. Both filtering approaches produced results similar to those from traditional methods, with the IFN approach producing results more consistent with previous theoretical interpretations of schizotypy. Then we evaluated how well both filtering approaches reproduced the global and local network characteristics of the two samples. We found that the IFN approach produced more consistent results for both global and local network characteristics. Finally, we sought to evaluate the predictability of the network centrality measures for each filtering approach, by determining the core, intermediate, and peripheral items on the WSS-SF and using them to predict interview reports of schizophrenia-spectrum symptoms. We found some similarities and differences in their effectiveness, with the IFN approach's network structure providing better overall predictive distinctions. We discuss the implications of our findings for schizotypy and for psychometric network analysis more generally.

Modeling genotypes in their microenvironment to predict single- and multi-cellular behavior

A cell's phenotype is the set of observable characteristics resulting from the interaction of the genotype with the surrounding environment, determining cell behavior. Deciphering genotype-phenotype relationships has been crucial to understanding normal and disease biology. Analysis of molecular pathways has provided an invaluable tool to such understanding; however, typically it does not consider the physical microenvironment, which is a key determinant of phenotype. In this study, we present a novel modeling framework that enables the study of the link between genotype, signaling networks, and cell behavior in a three-dimensional microenvironment. To achieve this, we bring together Agent-Based Modeling, a powerful computational modeling technique, and gene networks. This combination allows biological hypotheses to be tested in a controlled stepwise fashion, and it lends itself naturally to model a heterogeneous population of cells acting and evolving in a dynamic microenvironment, which is needed to predict the evolution of complex multi-cellular dynamics. Importantly, this enables modeling co-occurring intrinsic perturbations, such as mutations, and extrinsic perturbations, such as nutrient availability, and their interactions. Using cancer as a model system, we illustrate how this framework delivers a unique opportunity to identify determinants of single-cell behavior, while uncovering emerging properties of multi-cellular growth. This framework is freely available at http://www.microc.org.