Systems biology informed deep learning for inferring parameters and hidden dynamics

A data-driven personalized approach to predict blood glucose levels in type-1 diabetes patients exercising in free-living conditions

OBJECTIVE

The development of new technologies has generated vast amount of data that can be analyzed to better understand and predict the glycemic behavior of people living with type 1 diabetes. This paper aims to assess whether a data-driven approach can accurately and safely predict blood glucose levels in patients with type 1 diabetes exercising in free-living conditions.

METHODS

Multiple machine learning (XGBoost, Random Forest) and deep learning (LSTM, CNN-LSTM, Dual-encoder with Attention layer) regression models were considered. Each deep-learning model was implemented twice: first, as a personalized model trained solely on the target patient's data, and second, as a fine-tuned model of a population-based training model. The datasets used for training and testing the models were derived from the Type 1 Diabetes Exercise Initiative (T1DEXI). A total of 79 patients in T1DEXI met our inclusion criteria. Our models used various features related to continuous glucose monitoring, insulin pumps, carbohydrate intake, exercise (intensity and duration), and physical activity-related information (steps and heart rate). This data was available for four weeks for each of the 79 included patients. Three prediction horizons (10, 20, and 30 min) were tested and analyzed.

RESULTS

For each patient, there always exists either a machine learning or a deep learning model that conveniently predicts BGLs for up to 30 min. The best performing model differs from one patient to another. When considering the best performing model for each patient, the median and the mean Root Mean Squared Error (RMSE) values (across the 79 patients) for predictions made 10 min ahead were 6.99 mg/dL and 7.46 mg/dL, respectively. For predictions made 30 min ahead, the median and mean RMSE values were 16.85 mg/dL and 17.74 mg/dL, respectively. The majority of the predictions output by the best model of each patient fell within the clinically safe zones A and B of the Clarke Error Grid (CEG), with almost no predictions falling into the unsafe zone E. The most challenging patient to predict 30 min ahead achieved an RMSE value of 32.31 mg/dL (with the corresponding best performing model). The best-predicted patient had an RMSE value of 10.48 mg/dL. Predicting blood glucose levels was more difficult during and after exercise, resulting in higher RMSE values on average. Prediction errors during and after physical activity (two hours and four hours after) generally remained within the clinical safe zones of the CEG with less than 0.5% of predictions falling into the harmful zones D and E, regardless of the exercise category.

CONCLUSIONS

Data-driven approaches can accurately predict blood glucose levels in type 1 diabetes patients exercising in free-living conditions. The best-performing model varies across patients. Approaches in which a population-based model is initially trained and then fine-tuned for each individual patient generally achieve the best performance for the majority of patients. Some patients remain challenging to predict with no straightforward explanation of why a patient is more challenging to predict than another.

The Dawn of High-Throughput and Genome-Scale Kinetic Modeling: Recent Advances and Future Directions

Researchers have invested much effort into developing kinetic models due to their ability to capture dynamic behaviors, transient states, and regulatory mechanisms of metabolism, providing a detailed and realistic representation of cellular processes. Historically, the requirements for detailed parametrization and significant computational resources created barriers to their development and adoption for high-throughput studies. However, recent advancements, including the integration of machine learning with mechanistic metabolic models, the development of novel kinetic parameter databases, and the use of tailor-made parametrization strategies, are reshaping the field of kinetic modeling. In this Review, we discuss these developments and offer future directions, highlighting the potential of these advances to drive progress in systems and synthetic biology, metabolic engineering, and medical research at an unprecedented scale and pace.

Biological physics to uncover cell signaling

In this report, I describe some of the subjects and problems that we have addressed over the last 25 years in the area of cell signaling using the tools of biological physics. The report covers part of our work on intracellular Ca2 + signals, pattern formation, transport of messengers in the interior of cells, quantification of biophysical parameters from experiments, and information transmission. The description includes both our modeling and experimental work highlighting how the tools of physics can give useful insights into the workings of biological systems.

Learning stochastic reaction-diffusion models from limited data using spatiotemporal features

Pattern-forming stochastic systems arise throughout biology, with dynamic molecular waves observed in biochemical networks regulating critical cellular processes. Modeling these reaction-diffusion systems using handcrafted stochastic partial differential equations (PDEs) requires extensive trial-and-error tuning. Data-driven approaches for improved modeling are needed but have been hindered by data scarcity and noise. Here, we present a solution to the inverse problem of learning stochastic reaction-diffusion models from limited data by optimizing two spatiotemporal features: (1) stochastic dynamics and (2) spatiotemporal patterns. Combined with sparsity enforcement, this method identifies novel activator-inhibitor models with interpretable structure. We demonstrate robust learning from simulations of excitable systems with varying data scarcity, as well as noisy live-cell imaging data with low temporal resolution and a single observed biomolecule. This generalizable approach to learning governing stochastic PDEs enhances our ability to model and understand complex spatiotemporal systems from limited, real-world data.

A Framework for Parameter Estimation and Uncertainty Quantification in Systems Biology Using Quantile Regression and Physics-Informed Neural Networks

A framework for parameter estimation and uncertainty quantification is crucial for understanding the mechanisms of biological interactions within complex systems and exploring their dynamic behaviors beyond what can be experimentally observed. Despite recent advances, challenges remain in achieving the high accuracy of parameter estimation and uncertainty quantification at moderate computational costs. To tackle these challenges, we developed a novel approach that integrates the quantile method with Physics-Informed Neural Networks (PINNs). This method utilizes a network architecture with multiple parallel outputs, each corresponding to a distinct quantile, facilitating a comprehensive characterization of parameter estimation and its associated uncertainty. The effectiveness of the proposed approach was validated across three study cases, where it was compared to the Monte Carlo dropout (MCD) and the Bayesian methods. Furthermore, a larger-scale model was employed to further demonstrate the excellent performance of the proposed approach. Our approach exhibited significantly superior efficacy in parameter estimation and uncertainty quantification. This highlights its great promise to broaden the scope of applications in system biology modeling.

Challenges and opportunities in uncertainty quantification for healthcare and biological systems

Uncertainty quantification (UQ) is an essential aspect of computational modelling and statistical prediction. Multiple applications, including geophysics, climate science and aerospace engineering, incorporate UQ in the development and translation of new technologies. In contrast, the application of UQ to biological and healthcare models is understudied and suffers from several critical knowledge gaps. In an era of personalized medicine, patient-specific modelling, and digital twins, a lack of UQ understanding and appropriate implementation of UQ methodology limits the success of modelling and simulation in a clinical setting. The main contribution of our review article is to emphasize the importance and current deficiencies of UQ in the development of computational frameworks for healthcare and biological systems. As the introduction to the special issue on this topic, we provide an overview of UQ methodologies, their applications in non-biological and biological systems and the current gaps and opportunities for UQ development, as later highlighted by authors publishing in the special issue.This article is part of the theme issue 'Uncertainty quantification for healthcare and biological systems (Part 1)'.

Loss formulations for assumption-free neural inference of SDE coefficient functions

Stochastic differential equations (SDEs) are one of the most commonly studied probabilistic dynamical systems, and widely used to model complex biological processes. Building upon the previously introduced idea of performing inference of dynamical systems by parametrising their coefficient functions via neural networks, we propose a novel formulation for an optimisation objective that combines simulation-based penalties with pseudo-likelihoods. This greatly improves prediction performance compared to the state-of-the-art, and makes it possible to learn a wide variety of dynamics without any prior assumptions on analytical structure.

Diminishing spectral bias in physics-informed neural networks using spatially-adaptive Fourier feature encoding

Physics-informed neural networks (PINNs) have recently emerged as a promising framework for solving partial differential equation (PDE) systems in computer mechanics. However, PINNs still struggle in simulating systems whose solution functions exhibit high-frequency patterns, especially in cases with wide frequency spectrums. Current methods apply Fourier feature mappings to the input to improve the learning ability of model on high-frequency components. However, they are largely problem-dependent which require proper selection of hyperparameters and introduces additional training difficulty into the optimization. To this end, we present a spatially adaptive Fourier feature encoding method accompanied by a tree-based sampling strategy in this work. Specifically, we propose to guide the Fourier feature mappings of input by gradually exposing the input coordinate from low to higher encoding frequencies during training through the feedback loop of loss. Meanwhile, we also propose to refine the sampling of residual points by presenting a novel tree-based sampling strategy. This method represents the input domain by a tree and formulates the sampling of residual points as a resource allocation problem which optimizes the sampling of residual points during training and assigns more computational capacity to the underfit region. The effectiveness of our proposed method is demonstrated in several challenging PDE problems, including Poisson equation, heat equation, Navier-Stokes equations, Reynolds-Averaged Navier-Stokes equations, and Maxwell equation. The results indicate that our method can better allocate the computational resources during training and enable the model to fit the local frequencies of target function adaptively.

Inference of Onsager coefficient from microscopic simulations by machine learning

Dynamic density functional theory (DDFT) is a fruitful approach for modeling polymer dynamics, benefiting from its multiscale and hybrid nature. However, the Onsager coefficient, the only free parameter in DDFT, is primarily derived empirically, limiting the accuracy and broad application of DDFT. Herein, we propose a machine learning-based, bottom-up workflow to directly extract the Onsager coefficient from molecular simulations, circumventing partly heuristic assumptions in traditional approaches. In this workflow, the Onsager coefficient is derived from the proposed DDFT-informed ordinary differential equation network, trained to replicate density evolution observed in Brownian dynamics (BD) simulations. We validate our method by studying the lamellar transition in symmetric diblock copolymer melts, where the DDFT model with the extracted Onsager coefficient precisely reproduces both the density evolution and interface narrowing predicted by BD simulations, thereby demonstrating the reliability of the present scheme. Meanwhile, our studies reveal the strong relevance of the Onsager coefficient with dynamic processes and identify the explicit connection between dynamic correlations, characterized by the correlation strength and correlation length, and the system parameters, e.g., the Flory-Huggins interaction parameter. We found that far from the transition point, the correlation that transmits the thermodynamic force into a density current is localized and strong, while close to the transition point, it becomes long-ranged but weak. Our approach aims to develop a more generalized framework to bridge more refined particle-based simulations to more coarse-grained field-based calculations, and the insights gained by using our approach could be extended to other non-equilibrium systems in polymer sciences.

Predictive genetic circuit design for phenotype reprogramming in plants

Plants, with intricate molecular networks for environmental adaptation, offer groundbreaking potential for reprogramming with predictive genetic circuits. However, realizing this goal is challenging due to the long cultivation cycle of plants, as well as the lack of reproducible, quantitative methods and well-characterized genetic parts. Here, we establish a rapid (~10 days), quantitative, and predictive framework in plants. A group of orthogonal sensors, modular synthetic promoters, and NOT gates are constructed and quantitatively characterized. A predictive model is developed to predict the designed circuits' behavior accurately. Our versatile and robust framework, validated by constructing 21 two-input circuits with high prediction accuracy (R2 = 0.81), enables multi-state phenotype control in both Arabidopsis thaliana and Nicotiana benthamiana in response to chemical inducers. Our study achieves predictable design and application of synthetic circuits in plants, offering valuable tools for the rapid engineering of plant traits in biotechnology and agriculture.

Unravelling the impact of SARS-CoV-2 on hemostatic and complement systems: a systems immunology perspective

The hemostatic system prevents and stops bleeding, maintaining circulatory integrity after injury. It directly interacts with the complement system, which is key to innate immunity. In coronavirus disease 2019 (COVID-19), dysregulation of the hemostatic and complement systems has been associated with several complications. To understand the essential balance between activation and regulation of these systems, a quantitative systems immunology model can be established. The dynamics of the components are examined under three distinct conditions: the disease state representing symptomatic COVID-19 state, an intervened disease state marked by reduced levels of regulators, and drug interventions including heparin, tranexamic acid, avdoralimab, garadacimab, and tocilizumab. Simulation results highlight key components affected, including thrombin, tissue plasminogen activator, plasmin, fibrin degradation products, interleukin 6 (IL-6), the IL-6 and IL-6R complex, and the terminal complement complex (C5b-9). We explored that the decreased levels of complement factor H and C1-inhibitor significantly elevate these components, whereas tissue factor pathway inhibitor and alpha-2-macroglobulin have more modest effects. Furthermore, our analysis reveals that drug interventions have a restorative impact on these factors. Notably, targeting thrombin and plasmin in the early stages of thrombosis and fibrinolysis can improve the overall system. Additionally, the regulation of C5b-9 could aid in lysing the virus and/or infected cells. In conclusion, this study explains the regulatory mechanisms of the hemostatic and complement systems and illustrates how the biopathway machinery sustains the balance between activation and inhibition. The knowledge that we have acquired could contribute to designing therapies that target the hemostatic and complement systems.

Deep fuzzy physics-informed neural networks for forward and inverse PDE problems

As a grid-independent approach for solving partial differential equations (PDEs), Physics-Informed Neural Networks (PINNs) have garnered significant attention due to their unique capability to simultaneously learn from both data and the governing physical equations. Existing PINNs methods always assume that the data is stable and reliable, but data obtained from commercial simulation software often inevitably have ambiguous and inaccurate problems. Obviously, this will have a negative impact on the use of PINNs to solve forward and inverse PDE problems. To overcome the above problems, this paper proposes a Deep Fuzzy Physics-Informed Neural Networks (FPINNs) that explores the uncertainty in data. Specifically, to capture the uncertainty behind the data, FPINNs learns fuzzy representation through the fuzzy membership function layer and fuzzy rule layer. Afterward, we use deep neural networks to learn neural representation. Subsequently, the fuzzy representation is integrated with the neural representation. Finally, the residual of the physical equation and the data error are considered as the two components of the loss function, guiding the network to optimize towards adherence to the physical laws for accurate prediction of the physical field. Extensive experiment results show that FPINNs outperforms these comparative methods in solving forward and inverse PDE problems on four widely used datasets. The demo code will be released at https://github.com/siyuancncd/FPINNs.

Physiology-informed regularisation enables training of universal differential equation systems for biological applications

Systems biology tackles the challenge of understanding the high complexity in the internal regulation of homeostasis in the human body through mathematical modelling. These models can aid in the discovery of disease mechanisms and potential drug targets. However, on one hand the development and validation of knowledge-based mechanistic models is time-consuming and does not scale well with increasing features in medical data. On the other hand, data-driven approaches such as machine learning models require large volumes of data to produce generalisable models. The integration of neural networks and mechanistic models, forming universal differential equation (UDE) models, enables the automated learning of unknown model terms with less data than neural networks alone. Nevertheless, estimating parameters for these hybrid models remains difficult with sparse data and limited sampling durations that are common in biological applications. In this work, we propose the use of physiology-informed regularisation, penalising biologically implausible model behavior to guide the UDE towards more physiologically plausible regions of the solution space. In a simulation study we show that physiology-informed regularisation not only results in a more accurate forecasting of model behaviour, but also supports training with less data. We also applied this technique to learn a representation of the rate of glucose appearance in the glucose minimal model using meal response data measured in healthy people. In that case, the inclusion of regularisation reduces variability between UDE-embedded neural networks that were trained from different initial parameter guesses.

Identifying Heterogeneous Micromechanical Properties of Biological Tissues via Physics-Informed Neural Networks

The heterogeneous micromechanical properties of biological tissues have profound implications across diverse medical and engineering domains. However, identifying full-field heterogeneous elastic properties of soft materials using traditional engineering approaches is fundamentally challenging due to difficulties in estimating local stress fields. Recently, there has been a growing interest in data-driven models for learning full-field mechanical responses, such as displacement and strain, from experimental or synthetic data. However, research studies on inferring full-field elastic properties of materials, a more challenging problem, are scarce, particularly for large deformation, hyperelastic materials. Here, a physics-informed machine learning approach is proposed to identify the elasticity map in nonlinear, large deformation hyperelastic materials. This study reports the prediction accuracies and computational efficiency of physics-informed neural networks (PINNs) in inferring the heterogeneous elasticity maps across materials with structural complexity that closely resemble real tissue microstructure, such as brain, tricuspid valve, and breast cancer tissues. Further, the improved architecture is applied to three hyperelastic constitutive models: Neo-Hookean, Mooney Rivlin, and Gent. The improved network architecture consistently produces accurate estimations of heterogeneous elasticity maps, even when there is up to 10% noise present in the training data.

Adapting physics-informed neural networks to improve ODE optimization in mosquito population dynamics

Physics informed neural networks have been gaining popularity due to their unique ability to incorporate physics laws into data-driven models, ensuring that the predictions are not only consistent with empirical data but also align with domain-specific knowledge in the form of physics equations. The integration of physics principles enables the method to require less data while maintaining the robustness of deep learning in modelling complex dynamical systems. However, current PINN frameworks are not sufficiently mature for real-world ODE systems, especially those with extreme multi-scale behavior such as mosquito population dynamical modelling. In this research, we propose a PINN framework with several improvements for forward and inverse problems for ODE systems with a case study application in modelling the dynamics of mosquito populations. The framework tackles the gradient imbalance and stiff problems posed by mosquito ordinary differential equations. The method offers a simple but effective way to resolve the time causality issue in PINNs by gradually expanding the training time domain until it covers entire domain of interest. As part of a robust evaluation, we conduct experiments using simulated data to evaluate the effectiveness of the approach. Preliminary results indicate that physics-informed machine learning holds significant potential for advancing the study of ecological systems.

Hybrid Neural Differential Equations to Model Unknown Mechanisms and States in Biology

Efforts to model complex biological systems increasingly face challenges from ambiguous relationships within the model, such as through partially unknown mechanisms or unmodelled intermediate states. Hybrid neural differential equations are a recent modeling framework which has been previously shown to enable identification and prediction of complex phenomena, especially in the context of partially unknown mechanisms. We extend the application of hybrid neural differential equations to enable incorporation of theorized but unmodelled states within differential equation models. We find that beyond their capability to incorporate partially unknown mechanisms, hybrid neural differential equations provide an effective method to include knowledge of unmeasured states into differential equation models.

Coagulo-Net: Enhancing the mathematical modeling of blood coagulation using physics-informed neural networks

Blood coagulation, which involves a group of complex biochemical reactions, is a crucial step in hemostasis to stop bleeding at the injury site of a blood vessel. Coagulation abnormalities, such as hypercoagulation and hypocoagulation, could either cause thrombosis or hemorrhage, resulting in severe clinical consequences. Mathematical models of blood coagulation have been widely used to improve the understanding of the pathophysiology of coagulation disorders, guide the design and testing of new anticoagulants or other therapeutic agents, and promote precision medicine. However, estimating the parameters in these coagulation models has been challenging as not all reaction rate constants and new parameters derived from model assumptions are measurable. Although various conventional methods have been employed for parameter estimation for coagulation models, the existing approaches have several shortcomings. Inspired by the physics-informed neural networks, we propose Coagulo-Net, which synergizes the strengths of deep neural networks with the mechanistic understanding of the blood coagulation processes to enhance the mathematical models of the blood coagulation cascade. We assess the performance of the Coagulo-Net using two existing coagulation models with different extents of complexity. Our simulation results illustrate that Coagulo-Net can efficiently infer the unknown model parameters and dynamics of species based on sparse measurement data and data contaminated with noise. In addition, we show that Coagulo-Net can process a mixture of synthetic and experimental data and refine the predictions of existing mathematical models of coagulation. These results demonstrate the promise of Coagulo-Net in enhancing current coagulation models and aiding the creation of novel models for physiological and pathological research. These results showcase the potential of Coagulo-Net to advance computational modeling in the study of blood coagulation, improving both research methodologies and the development of new therapies for treating patients with coagulation disorders.

Kolmogorov n-widths for multitask physics-informed machine learning (PIML) methods: Towards robust metrics

Physics-informed machine learning (PIML) as a means of solving partial differential equations (PDEs) has garnered much attention in the Computational Science and Engineering (CS&E) world. This topic encompasses a broad array of methods and models aimed at solving a single or a collection of PDE problems, called multitask learning. PIML is characterized by the incorporation of physical laws into the training process of machine learning models in lieu of large data when solving PDE problems. Despite the overall success of this collection of methods, it remains incredibly difficult to analyze, benchmark, and generally compare one approach to another. Using Kolmogorov n-widths as a measure of effectiveness of approximating functions, we judiciously apply this metric in the comparison of various multitask PIML architectures. We compute lower accuracy bounds and analyze the model's learned basis functions on various PDE problems. This is the first objective metric for comparing multitask PIML architectures and helps remove uncertainty in model validation from selective sampling and overfitting. We also identify avenues of improvement for model architectures, such as the choice of activation function, which can drastically affect model generalization to "worst-case" scenarios, which is not observed when reporting task-specific errors. We also incorporate this metric into the optimization process through regularization, which improves the models' generalizability over the multitask PDE problem.

Robust parameter estimation and identifiability analysis with hybrid neural ordinary differential equations in computational biology

Parameter estimation is one of the central challenges in computational biology. In this paper, we present an approach to estimate model parameters and assess their identifiability in cases where only partial knowledge of the system structure is available. The partially known model is embedded into a system of hybrid neural ordinary differential equations, with neural networks capturing unknown system components. Integrating neural networks into the model presents two main challenges: global exploration of the mechanistic parameter space during optimization and potential loss of parameter identifiability due to the neural network flexibility. To tackle these challenges, we treat biological parameters as hyperparameters, allowing for global search during hyperparameter tuning. We then conduct a posteriori identifiability analysis, extending a well-established method for mechanistic models. The pipeline performance is evaluated on three test cases designed to replicate real-world conditions, including noisy data and limited system observability.

Towards verifiable cancer digital twins: tissue level modeling protocol for precision medicine

Cancer exhibits substantial heterogeneity, manifesting as distinct morphological and molecular variations across tumors, which frequently undermines the efficacy of conventional oncological treatments. Developments in multiomics and sequencing technologies have paved the way for unraveling this heterogeneity. Nevertheless, the complexity of the data gathered from these methods cannot be fully interpreted through multimodal data analysis alone. Mathematical modeling plays a crucial role in delineating the underlying mechanisms to explain sources of heterogeneity using patient-specific data. Intra-tumoral diversity necessitates the development of precision oncology therapies utilizing multiphysics, multiscale mathematical models for cancer. This review discusses recent advancements in computational methodologies for precision oncology, highlighting the potential of cancer digital twins to enhance patient-specific decision-making in clinical settings. We review computational efforts in building patient-informed cellular and tissue-level models for cancer and propose a computational framework that utilizes agent-based modeling as an effective conduit to integrate cancer systems models that encode signaling at the cellular scale with digital twin models that predict tissue-level response in a tumor microenvironment customized to patient information. Furthermore, we discuss machine learning approaches to building surrogates for these complex mathematical models. These surrogates can potentially be used to conduct sensitivity analysis, verification, validation, and uncertainty quantification, which is especially important for tumor studies due to their dynamic nature.

Identifying effective evolutionary strategies-based protocol for uncovering reaction kinetic parameters under the effect of measurement noises

BACKGROUND

The transition from explanative modeling of fitted data to the predictive modeling of unseen data for systems biology endeavors necessitates the effective recovery of reaction parameters. Yet, the relative efficacy of optimization algorithms in doing so remains under-studied, as to the specific reaction kinetics and the effect of measurement noises. To this end, we simulate the reactions of an artificial pathway using 4 kinetic formulations: generalized mass action (GMA), Michaelis-Menten, linear-logarithmic, and convenience kinetics. We then compare the effectiveness of 5 evolutionary algorithms (CMAES, DE, SRES, ISRES, G3PCX) for objective function optimization in kinetic parameter hyperspace to determine the corresponding estimated parameters.

RESULTS

We quickly dropped the DE algorithm due to its poor performance. Baring measurement noise, we find the CMAES algorithm to only require a fraction of the computational cost incurred by other EAs for both GMA and linear-logarithmic kinetics yet performing as well by other criteria. However, with increasing noise, SRES and ISRES perform more reliably for GMA kinetics, but at considerably higher computational cost. Conversely, G3PCX is among the most efficacious for estimating Michaelis-Menten parameters regardless of noise, while achieving numerous folds saving in computational cost. Cost aside, we find SRES to be versatilely applicable across GMA, Michaelis-Menten, and linear-logarithmic kinetics, with good resilience to noise. Nonetheless, we could not identify the parameters of convenience kinetics using any algorithm.

CONCLUSIONS

Altogether, we identify a protocol for predicting reaction parameters under marked measurement noise, as a step towards predictive modeling for systems biology endeavors.

Mathematical Modeling and Inference of Epidermal Growth Factor-Induced Mitogen-Activated Protein Kinase Cell Signaling Pathways

The mitogen-activated protein kinase (MAPK) pathway is an important intracellular signaling cascade that plays a key role in various cellular processes. Understanding the regulatory mechanisms of this pathway is essential for developing effective interventions and targeted therapies for related diseases. Recent advances in single-cell proteomic technologies have provided unprecedented opportunities to investigate the heterogeneity and noise within complex, multi-signaling networks across diverse cells and cell types. Mathematical modeling has become a powerful interdisciplinary tool that bridges mathematics and experimental biology, providing valuable insights into these intricate cellular processes. In addition, statistical methods have been developed to infer pathway topologies and estimate unknown parameters within dynamic models. This review presents a comprehensive analysis of how mathematical modeling of the MAPK pathway deepens our understanding of its regulatory mechanisms, enhances the prediction of system behavior, and informs experimental research, with a particular focus on recent advances in modeling and inference using single-cell proteomic data.

Learning metabolic dynamics from irregular observations by Bidirectional Time-Series State Transfer Network

Modeling microbial metabolic dynamics is important for the rational optimization of both biosynthetic systems and industrial processes to facilitate green and efficient biomanufacturing. Classical approaches utilize explicit equation systems to represent metabolic networks, enabling the quantification of pathway fluxes to identify metabolic bottlenecks. However, these white-box models, despite their diverse applications, have limitations in simulating metabolic dynamics and are intrinsically inaccurate for industrial strains that lack information on network structures and kinetic parameters. On the other hand, black-box models do not rely on prior mechanistic knowledge of strains but are built upon observed time-series trajectories of biosynthetic systems in action. In practice, these observations are typically irregular, with discontinuously observed time points across multiple independent batches, each time point potentially containing missing measurements. Learning from such irregular data remains challenging for existing approaches. To address this issue, we present the Bidirectional Time-Series State Transfer Network (BTSTN) for modeling metabolic dynamics directly from irregular observations. Using evaluation data sets derived from both ideal dynamic systems and a real-world fermentation process, we demonstrate that BTSTN accurately reconstructs dynamic behaviors and predicts future trajectories. This approach exhibits enhanced robustness against missing measurements and noise, as compared to the state-of-the-art methods.IMPORTANCEIndustrial biosynthetic systems often involve strains with unclear genetic backgrounds, posing challenges in modeling their distinct metabolic dynamics. In such scenarios, white-box models, which commonly rely on inferred networks, are thereby of limited applicability and accuracy. In contrast, black-box models, such as statistical models and neural networks, are directly fitted or learned from observed time-series trajectories of biosynthetic systems in action. These methods typically assume regular observations without missing time points or measurements. If the observations are irregular, a pre-processing step becomes necessary to obtain a fully filled data set for subsequent model training, which, at the same time, inevitably introduces errors into the resulting models. BTSTN is a novel approach that natively learns from irregular observations. This distinctive feature makes it a unique addition to the current arsenal of technologies modeling metabolic dynamics.

Identifying heterogeneous micromechanical properties of biological tissues via physics-informed neural networks

The heterogeneous micromechanical properties of biological tissues have profound implications across diverse medical and engineering domains. However, identifying full-field heterogeneous elastic properties of soft materials using traditional engineering approaches is fundamentally challenging due to difficulties in estimating local stress fields. Recently, there has been a growing interest in using data-driven models to learn full-field mechanical responses such as displacement and strain from experimental or synthetic data. However, research studies on inferring full-field elastic properties of materials, a more challenging problem, are scarce, particularly for large deformation, hyperelastic materials. Here, we propose a physics-informed machine learning approach to identify the elasticity map in nonlinear, large deformation hyperelastic materials. We evaluate the prediction accuracies and computational efficiency of physics-informed neural networks (PINNs) by inferring the heterogeneous elasticity maps across three materials with structural complexity that closely resemble real tissue patterns, such as brain tissue and tricuspid valve tissue. We further applied our improved architecture to three additional examples of breast cancer tissue and extended our analysis to three hyperelastic constitutive models: Neo-Hookean, Mooney Rivlin, and Gent. Our selected network architecture consistently produced highly accurate estimations of heterogeneous elasticity maps, even when there was up to 10% noise present in the training data.

Exploring gene regulation and biological processes in insects: Insights from omics data using gene regulatory network models

Gene regulatory network (GRN) comprises complicated yet intertwined gene-regulator relationships. Understanding the GRN dynamics will unravel the complexity behind the observed gene expressions. Insect gene regulation is often complicated due to their complex life cycles and diverse ecological adaptations. The main interest of this review is to have an update on the current mathematical modelling methods of GRNs to explain insect science. Several popular GRN architecture models are discussed, together with examples of applications in insect science. In the last part of this review, each model is compared from different aspects, including network scalability, computation complexity, robustness to noise and biological relevancy.

Bridging systems biology and tissue engineering: Unleashing the full potential of complex 3D in vitro tissue models of disease

Rapid advances in tissue engineering have resulted in more complex and physiologically relevant 3D in vitro tissue models with applications in fundamental biology and therapeutic development. However, the complexity provided by these models is often not leveraged fully due to the reductionist methods used to analyze them. Computational and mathematical models developed in the field of systems biology can address this issue. Yet, traditional systems biology has been mostly applied to simpler in vitro models with little physiological relevance and limited cellular complexity. Therefore, integrating these two inherently interdisciplinary fields can result in new insights and move both disciplines forward. In this review, we provide a systematic overview of how systems biology has been integrated with 3D in vitro tissue models and discuss key application areas where the synergies between both fields have led to important advances with potential translational impact. We then outline key directions for future research and discuss a framework for further integration between fields.

A review of mechanistic learning in mathematical oncology

Mechanistic learning refers to the synergistic combination of mechanistic mathematical modeling and data-driven machine or deep learning. This emerging field finds increasing applications in (mathematical) oncology. This review aims to capture the current state of the field and provides a perspective on how mechanistic learning may progress in the oncology domain. We highlight the synergistic potential of mechanistic learning and point out similarities and differences between purely data-driven and mechanistic approaches concerning model complexity, data requirements, outputs generated, and interpretability of the algorithms and their results. Four categories of mechanistic learning (sequential, parallel, extrinsic, intrinsic) of mechanistic learning are presented with specific examples. We discuss a range of techniques including physics-informed neural networks, surrogate model learning, and digital twins. Example applications address complex problems predominantly from the domain of oncology research such as longitudinal tumor response predictions or time-to-event modeling. As the field of mechanistic learning advances, we aim for this review and proposed categorization framework to foster additional collaboration between the data- and knowledge-driven modeling fields. Further collaboration will help address difficult issues in oncology such as limited data availability, requirements of model transparency, and complex input data which are embraced in a mechanistic learning framework.

AI-Aristotle: A physics-informed framework for systems biology gray-box identification

Discovering mathematical equations that govern physical and biological systems from observed data is a fundamental challenge in scientific research. We present a new physics-informed framework for parameter estimation and missing physics identification (gray-box) in the field of Systems Biology. The proposed framework-named AI-Aristotle-combines the eXtreme Theory of Functional Connections (X-TFC) domain-decomposition and Physics-Informed Neural Networks (PINNs) with symbolic regression (SR) techniques for parameter discovery and gray-box identification. We test the accuracy, speed, flexibility, and robustness of AI-Aristotle based on two benchmark problems in Systems Biology: a pharmacokinetics drug absorption model and an ultradian endocrine model for glucose-insulin interactions. We compare the two machine learning methods (X-TFC and PINNs), and moreover, we employ two different symbolic regression techniques to cross-verify our results. To test the performance of AI-Aristotle, we use sparse synthetic data perturbed by uniformly distributed noise. More broadly, our work provides insights into the accuracy, cost, scalability, and robustness of integrating neural networks with symbolic regressors, offering a comprehensive guide for researchers tackling gray-box identification challenges in complex dynamical systems in biomedicine and beyond.

Inferring biophysical properties of membranes during endocytosis using machine learning

Endocytosis is a fundamental cellular process in eukaryotic cells that facilitates the transport of molecules into the cell. With the help of fluorescence microscopy and electron tomography, researchers have accumulated extensive geometric data of membrane shapes during endocytosis. These data contain rich information about the mechanical properties of membranes, which are hard to access via experiments due to the small dimensions of the endocytic patch. In this study, we propose an approach that combines machine learning with the Helfrich theory of membranes to infer the mechanical properties of membranes during endocytosis from a dataset of membrane shapes extracted from electron tomography. Our results demonstrate that machine learning can output solutions that both match the experimental profile and satisfy the membrane shape equations derived from Helfrich theory. The learning results show that during the early stage of endocytosis, the inferred membrane tension is negative, indicating the presence of strong compressive forces at the boundary of the endocytic invagination. Our method presents a generic framework for extracting membrane information from super-resolution imaging.

Data-driven discovery of sparse dynamical model of cardiovascular system for model predictive control

Cardiovascular diseases remain the leading cause of death globally. In recent years, vagal nerve stimulation (VNS) has shown promising results in the treatment of a number of cardiovascular diseases. In this approach, mild electrical pulses are sent to the brain via the vagus nerve. This open-loop neurostimulation, however, leads to various side effects due to physiological and inter-patient variability and therefore a closed-loop delivery strategy of electrical pulses that accounts for this variability is desired. In this context, we envision data-driven sparse dynamical model parameterized by patient-specific data as appropriate for use in closed loop controller design. In this work, we build a dynamical model for mean arterial pressure and heart rate using the method sparse identification of nonlinear dynamics (SINDy). As a proxy for real datasets or measurements from a patient, we simulate a mechanistic model from the literature and then discover a data-driven model for predicting mean arterial pressure and heart rate in response to neural stimulus. This discovered model is then used to design a controller to be implemented in closed-loop via model predictive control. We observe that this data-driven model is interpretable, consistent with experiments, provides insights on the sensitivity of different stimulation locations and simplifies the formulation of the optimal control problem. Noting the set-point tracking performance of this closed-loop model-based controller that uses this discovered model, we conclude that the model is adequate in capturing the dynamics of a highly nonlinear cardiovascular system for the purpose of optimal predictive controller design.

A multi-resolution physics-informed recurrent neural network: formulation and application to musculoskeletal systems

This work presents a multi-resolution physics-informed recurrent neural network (MR PI-RNN), for simultaneous prediction of musculoskeletal (MSK) motion and parameter identification of the MSK systems. The MSK application was selected as the model problem due to its challenging nature in mapping the high-frequency surface electromyography (sEMG) signals to the low-frequency body joint motion controlled by the MSK and muscle contraction dynamics. The proposed method utilizes the fast wavelet transform to decompose the mixed frequency input sEMG and output joint motion signals into nested multi-resolution signals. The prediction model is subsequently trained on coarser-scale input-output signals using a gated recurrent unit (GRU), and then the trained parameters are transferred to the next level of training with finer-scale signals. These training processes are repeated recursively under a transfer-learning fashion until the full-scale training (i.e., with unfiltered signals) is achieved, while satisfying the underlying dynamic equilibrium. Numerical examples on recorded subject data demonstrate the effectiveness of the proposed framework in generating a physics-informed forward-dynamics surrogate, which yields higher accuracy in motion predictions of elbow flexion-extension of an MSK system compared to the case with single-scale training. The framework is also capable of identifying muscle parameters that are physiologically consistent with the subject's kinematics data.

A topological classifier to characterize brain states: When shape matters more than variance

Despite the remarkable accuracies attained by machine learning classifiers to separate complex datasets in a supervised fashion, most of their operation falls short to provide an informed intuition about the structure of data, and, what is more important, about the phenomena being characterized by the given datasets. By contrast, topological data analysis (TDA) is devoted to study the shape of data clouds by means of persistence descriptors and provides a quantitative characterization of specific topological features of the dataset under scrutiny. Here we introduce a novel TDA-based classifier that works on the principle of assessing quantifiable changes on topological metrics caused by the addition of new input to a subset of data. We used this classifier with a high-dimensional electro-encephalographic (EEG) dataset recorded from eleven participants during a previous decision-making experiment in which three motivational states were induced through a manipulation of social pressure. We calculated silhouettes from persistence diagrams associated with each motivated state with a ready-made band-pass filtered version of these signals, and classified unlabeled signals according to their impact on each reference silhouette. Our results show that in addition to providing accuracies within the range of those of a nearest neighbour classifier, the TDA classifier provides formal intuition of the structure of the dataset as well as an estimate of its intrinsic dimension. Towards this end, we incorporated variance-based dimensionality reduction methods to our dataset and found that in most cases the accuracy of our TDA classifier remains essentially invariant beyond a certain dimension.

Transmission dynamics informed neural network with application to COVID-19 infections

Since the end of 2019 the COVID-19 repeatedly surges with most countries/territories experiencing multiple waves, and mechanism-based epidemic models played important roles in understanding the transmission mechanism of multiple epidemic waves. However, capturing temporal changes of the transmissibility of COVID-19 during the multiple waves keeps ill-posed problem for traditional mechanism-based epidemic compartment models, because that the transmission rate is usually assumed to be specific piecewise functions and more parameters are added to the model once multiple epidemic waves involved, which poses a huge challenge to parameter estimation. Meanwhile, data-driven deep neural networks fail to discover the driving factors of repeated outbreaks and lack interpretability. In this study, aiming at developing a data-driven method to project time-dependent parameters but also merging the advantage of mechanism-based models, we propose a transmission dynamics informed neural network (TDINN) by encoding the SEIRD compartment model into deep neural networks. We show that the proposed TDINN algorithm performs very well when fitting the COVID-19 epidemic data with multiple waves, where the epidemics in the United States, Italy, South Africa, and Kenya, and several outbreaks the Omicron variant in China are taken as examples. In addition, the numerical simulation shows that the trained TDINN can also perform as a predictive model to capture the future development of COVID-19 epidemic. We find that the transmission rate inferred by the TDINN frequently fluctuates, and a feedback loop between the epidemic shifting and the changes of transmissibility drives the occurrence of multiple waves. We observe a long response delay to the implementation of control interventions in the four countries, while the decline of the transmission rate in the outbreaks in China usually happens once the implementation of control interventions. The further simulation show that 17 days' delay of the response to the implementation of control interventions lead to a roughly four-fold increase in daily reported cases in one epidemic wave in Italy, which suggest that a rapid response to policies that strengthen control interventions can be effective in flattening the epidemic curve or avoiding subsequent epidemic waves. We observe that the transmission rate in the outbreaks in China is already decreasing before enhancing control interventions, providing the evidence that the increasing of the epidemics can drive self-conscious behavioural changes to protect against infections.

Physics-informed neural network-based serial hybrid model capturing the hidden kinetics for sulfur-driven autotrophic denitrification process

Sulfur-driven autotrophic denitrification (SdAD) is a biological process that can remove nitrate from low carbon/nitrogen (C/N) ratio wastewater. Although this process has been intensively researched, the mechanism whereby its intermediates (i.e., elemental sulfur and nitrite ions) are generated and accumulated remains elusive. Existing mathematical models developed for SdAD cannot accurately predict the intermediates in SdAD because of the incomplete knowledge of process kinetic resulting from changes in the environmental conditions and electron competition during SdAD. To address this limitation, we proposed a novel serial hybrid model structure based on a physics-informed neural network (PINN) to capture the dynamics of the process kinetics and predict the substrate concentrations in SdAD. In this study, we evaluated the model through numerical experiments and applied it to real case studies involving batch and continuous-flow reactor scenarios. By leveraging the PINN approach, the hybrid model yielded accurate predictions at both the state (i.e. substrate concentration) and kinetic levels in the numerical experiments and performed better than both mechanistic and purely data-driven models in the case studies. Furthermore, we used the trained hybrid model to design control strategies for SdAD and a novel integrated process involving SdAD and anammox for energy-efficient nitrogen removal. Finally, we discuss the advantages and application scope of the PINN-based hybrid model.

Integrating a tailored recurrent neural network with Bayesian experimental design to optimize microbial community functions

Microbiomes interact dynamically with their environment to perform exploitable functions such as production of valuable metabolites and degradation of toxic metabolites for a wide range of applications in human health, agriculture, and environmental cleanup. Developing computational models to predict the key bacterial species and environmental factors to build and optimize such functions are crucial to accelerate microbial community engineering. However, there is an unknown web of interactions that determine the highly complex and dynamic behavior of these systems, which precludes the development of models based on known mechanisms. By contrast, entirely data-driven machine learning models can produce physically unrealistic predictions and often require significant amounts of experimental data to learn system behavior. We develop a physically-constrained recurrent neural network that preserves model flexibility but is constrained to produce physically consistent predictions and show that it can outperform existing machine learning methods in the prediction of certain experimentally measured species abundance and metabolite concentrations. Further, we present a closed-loop, Bayesian experimental design algorithm to guide data collection by selecting experimental conditions that simultaneously maximize information gain and target microbial community functions. Using a bioreactor case study, we demonstrate how the proposed framework can be used to efficiently navigate a large design space to identify optimal operating conditions. The proposed methodology offers a flexible machine learning approach specifically tailored to optimize microbiome target functions through the sequential design of informative experiments that seek to explore and exploit community functions.

Large area optimization of meta-lens via data-free machine learning

Sub-wavelength diffractive optics, commonly known as meta-optics, present a complex numerical simulation challenge, due to their multi-scale nature. The behavior of constituent sub-wavelength scatterers, or meta-atoms, needs to be modeled by full-wave electromagnetic simulations, whereas the whole meta-optical system can be modeled using ray/ Fourier optics. Most simulation techniques for large-scale meta-optics rely on the local phase approximation (LPA), where the coupling between dissimilar meta-atoms is neglected. Here we introduce a physics-informed neural network, coupled with the overlapping boundary method, which can efficiently model the meta-optics while still incorporating all of the coupling between meta-atoms. We demonstrate the efficacy of our technique by designing 1mm aperture cylindrical meta-lenses exhibiting higher efficiency than the ones designed under LPA. We experimentally validated the maximum intensity improvement (up to 53%) of the inverse-designed meta-lens. Our reported method can design large aperture ( ~ 104 − 105λ ) meta-optics in a reasonable time (approximately 15 minutes on a graphics processing unit) without relying on the LPA.

Zhelyeznyakov and coworkers present a data-free physics-informed neural network to model and optimize the electromagnetic field distribution of large-scale ( ~ 1 mm in diameter) optical meta-lenses. This simplified method can speed up the design of large aperture meta-optics.

Recent Advances in Deep Learning for Protein-Protein Interaction Analysis: A Comprehensive Review

Deep learning, a potent branch of artificial intelligence, is steadily leaving its transformative imprint across multiple disciplines. Within computational biology, it is expediting progress in the understanding of Protein-Protein Interactions (PPIs), key components governing a wide array of biological functionalities. Hence, an in-depth exploration of PPIs is crucial for decoding the intricate biological system dynamics and unveiling potential avenues for therapeutic interventions. As the deployment of deep learning techniques in PPI analysis proliferates at an accelerated pace, there exists an immediate demand for an exhaustive review that encapsulates and critically assesses these novel developments. Addressing this requirement, this review offers a detailed analysis of the literature from 2021 to 2023, highlighting the cutting-edge deep learning methodologies harnessed for PPI analysis. Thus, this review stands as a crucial reference for researchers in the discipline, presenting an overview of the recent studies in the field. This consolidation helps elucidate the dynamic paradigm of PPI analysis, the evolution of deep learning techniques, and their interdependent dynamics. This scrutiny is expected to serve as a vital aid for researchers, both well-established and newcomers, assisting them in maneuvering the rapidly shifting terrain of deep learning applications in PPI analysis.

Effective data sampling strategies and boundary condition constraints of physics-informed neural networks for identifying material properties in solid mechanics

Material identification is critical for understanding the relationship between mechanical properties and the associated mechanical functions. However, material identification is a challenging task, especially when the characteristic of the material is highly nonlinear in nature, as is common in biological tissue. In this work, we identify unknown material properties in continuum solid mechanics via physics-informed neural networks (PINNs). To improve the accuracy and efficiency of PINNs, we develop efficient strategies to nonuniformly sample observational data. We also investigate different approaches to enforce Dirichlet-type boundary conditions (BCs) as soft or hard constraints. Finally, we apply the proposed methods to a diverse set of time-dependent and time-independent solid mechanic examples that span linear elastic and hyperelastic material space. The estimated material parameters achieve relative errors of less than 1%. As such, this work is relevant to diverse applications, including optimizing structural integrity and developing novel materials.

Parameter Inference for an Astrocyte Model using Machine Learning Approaches

Astrocytes are the largest subset of glial cells and perform structural, metabolic, and regulatory functions. They are directly involved in the communication at neuronal synapses and the maintenance of brain homeostasis. Several disorders, such as Alzheimer's, epilepsy, and schizophrenia, have been associated with astrocyte dysfunction. Computational models on various spatial levels have been proposed to aid in the understanding and research of astrocytes. The difficulty of computational astrocyte models is to fastly and precisely infer parameters. Physics informed neural networks (PINNs) use the underlying physics to infer parameters and, if necessary, dynamics that can not be observed. We have applied PINNs to estimate parameters for a computational model of an astrocytic compartment. The addition of two techniques helped with the gradient pathologies of the PINNS, the dynamic weighting of various loss components and the addition of Transformers. To overcome the issue that the neural network only learned the time dependence but did not know about eventual changes of the input stimulation to the astrocyte model, we followed an adaptation of PINNs from control theory (PINCs). In the end, we were able to infer parameters from artificial, noisy data, with stable results for the computational astrocyte model.

Integration of a multi-omics stem cell differentiation dataset using a dynamical model

Stem cell differentiation is a highly dynamic process involving pervasive changes in gene expression. The large majority of existing studies has characterized differentiation at the level of individual molecular profiles, such as the transcriptome or the proteome. To obtain a more comprehensive view, we measured protein, mRNA and microRNA abundance during retinoic acid-driven differentiation of mouse embryonic stem cells. We found that mRNA and protein abundance are typically only weakly correlated across time. To understand this finding, we developed a hierarchical dynamical model that allowed us to integrate all data sets. This model was able to explain mRNA-protein discordance for most genes and identified instances of potential microRNA-mediated regulation. Overexpression or depletion of microRNAs identified by the model, followed by RNA sequencing and protein quantification, were used to follow up on the predictions of the model. Overall, our study shows how multi-omics integration by a dynamical model could be used to nominate candidate regulators.

Modal wavenumber estimation by combining physical informed neural network

Estimation of modal wavenumbers is important for inference of geoacoustic properties and data-driven matched field processing in shallow water waveguides. This paper introduces a deep neural network called combining physical informed neural network (CPINN) for modal wavenumber estimation using a vertical linear array (VLA). Note that the sound field recorded by a VLA can be expressed as a linear superposition of finite modal depth functions, and the differential equations satisfied by the modal depth functions are related to the corresponding modal wavenumbers. CPINN can estimate the modal wavenumbers by introducing the proxies of the modal depth functions and constraining them to satisfy the corresponding differential equations. The performance of the CPINN is evaluated by simulated data in a noisy shallow water environment. Numerical results show that, when compared with the previous methods, CPINN does not need to know the exact horizontal distance between the sound source and the VLA. Moreover, CPINN can estimate the modal wavenumbers at the VLA position in the case where the range segment traversed by the source, i.e., the aperture in the range direction, is smaller than the maximum modal cycle distance and in a range-dependent waveguide.

Physics-informed neural entangled-ladder network for inhalation impedance of the respiratory system

BACKGROUND AND OBJECTIVES

The use of machine learning methods for modelling bio-systems is becoming prominent which can further improve bio-medical technologies. Physics-informed neural networks (PINNs) can embed the knowledge of physical laws that govern a system during the model training process. PINNs utilise differential equations in the model which traditionally used numerical methods that are computationally complex.

METHODS

We integrate PINNs with an entangled ladder network for modelling respiratory systems by considering a lungs conduction zone to evaluate the respiratory impedance for different initial conditions. We evaluate the respiratory impedance for the inhalation phase of breathing for a symmetric model of the human lungs using entanglement and continued fractions.

RESULTS

We obtain the impedance of the conduction zone of the lungs pulmonary airways using PINNs for nine different combinations of velocity and pressure of inhalation. We compare the results from PINNs with the finite element method using the mean absolute error and root mean square error. The results show that the impedance obtained with PINNs contrasts with the conventional forced oscillation test used for deducing the respiratory impedance. The results show similarity with the impedance plots for different respiratory diseases.

CONCLUSION

We find a decrease in impedance when the velocity of breathing is lowered gradually by 20%. Hence, the methodology can be used to design smart ventilators to the improve flow of breathing.

Uncertainty quantification in mechanistic epidemic models via cross-entropy approximate Bayesian computation

This paper proposes a data-driven approximate Bayesian computation framework for parameter estimation and uncertainty quantification of epidemic models, which incorporates two novelties: (i) the identification of the initial conditions by using plausible dynamic states that are compatible with observational data; (ii) learning of an informative prior distribution for the model parameters via the cross-entropy method. The new methodology's effectiveness is illustrated with the aid of actual data from the COVID-19 epidemic in Rio de Janeiro city in Brazil, employing an ordinary differential equation-based model with a generalized SEIR mechanistic structure that includes time-dependent transmission rate, asymptomatics, and hospitalizations. A minimization problem with two cost terms (number of hospitalizations and deaths) is formulated, and twelve parameters are identified. The calibrated model provides a consistent description of the available data, able to extrapolate forecasts over a few weeks, making the proposed methodology very appealing for real-time epidemic modeling.

Crosstalk between biochemical signalling network architecture and trafficking governs AMPAR dynamics in synaptic plasticity

Synaptic plasticity involves modification of both biochemical and structural components of neurons. Many studies have revealed that the change in the number density of the glutamatergic receptor AMPAR at the synapse is proportional to synaptic weight update; an increase in AMPAR corresponds to strengthening of synapses while a decrease in AMPAR density weakens synaptic connections. The dynamics of AMPAR are thought to be regulated by upstream signalling, primarily the calcium-CaMKII pathway, trafficking to and from the synapse, and influx from extrasynaptic sources. Previous work in the field of deterministic modelling of CaMKII dynamics has assumed bistable kinetics, while experiments and rule-based modelling have revealed that CaMKII dynamics can be either monostable or ultrasensitive. This raises the following question: how does the choice of model assumptions involving CaMKII dynamics influence AMPAR dynamics at the synapse? To answer this question, we have developed a set of models using compartmental ordinary differential equations to systematically investigate contributions of different signalling and trafficking variations, along with their coupled effects, on AMPAR dynamics at the synaptic site. We find that the properties of the model including network architecture describing different stability features of CaMKII and parameters that capture the endocytosis and exocytosis of AMPAR significantly affect the integration of fast upstream species by slower downstream species. Furthermore, we predict that the model outcome, as determined by bound AMPAR at the synaptic site, depends on (1) the choice of signalling model (bistable CaMKII or monostable CaMKII dynamics), (2) trafficking versus influx contributions and (3) frequency of stimulus. KEY POINTS: The density of AMPA receptors (AMPARs) at the postsynaptic density of the synapse provides a readout of synaptic plasticity, which involves crosstalk between complex biochemical signalling networks including CaMKII dynamics and trafficking pathways including exocytosis and endocytosis. Here we build a model that integrates CaMKII dynamics and AMPAR trafficking to explore this crosstalk. We compare different models of CaMKII that result in monostable or bistable kinetics and their impact on AMPAR dynamics. Our results show that AMPAR density depends on the coupling between aspects of biochemical signalling and trafficking. Specifically, assumptions regarding CaMKII dynamics and its stability features can alter AMPAR density at the synapse. Our model also predicts that the kinetics of trafficking versus influx of AMPAR from the extrasynaptic space can further impact AMPAR density. Thus, the contributions of both signalling and trafficking should be considered in computational models.

Systems Biology: Identifiability Analysis and Parameter Identification via Systems-Biology-Informed Neural Networks

The dynamics of systems biological processes are usually modeled by a system of ordinary differential equations (ODEs) with many unknown parameters that need to be inferred from noisy and sparse measurements. Here, we introduce systems-biology-informed neural networks for parameter estimation by incorporating the system of ODEs into the neural networks. To complete the workflow of system identification, we also describe structural and practical identifiability analysis to analyze the identifiability of parameters. We use the ultradian endocrine model for glucose-insulin interaction as the example to demonstrate all these methods and their implementation.

Theranostic digital twins for personalized radiopharmaceutical therapies: Reimagining theranostics via computational nuclear oncology

This work emphasizes that patient data, including images, are not operable (clinically), but that digital twins are. Based on the former, the latter can be created. Subsequently, virtual clinical operations can be performed towards selection of optimal therapies. Digital twins are beginning to emerge in the field of medicine. We suggest that theranostic digital twins (TDTs) are amongst the most natural and feasible flavors of digitals twins. We elaborate on the importance of TDTs in a future where 'one-size-fits-all' therapeutic schemes, as prevalent nowadays, are transcended in radiopharmaceutical therapies (RPTs). Personalized RPTs will be deployed, including optimized intervention parameters. Examples include optimization of injected radioactivities, sites of injection, injection intervals and profiles, and combination therapies. Multi-modal multi-scale images, combined with other data and aided by artificial intelligence (AI) techniques, will be utilized towards routine digital twinning of our patients, and will enable improved deliveries of RPTs and overall healthcare.

A Feature-Encoded Physics-Informed Parameter Identification Neural Network for Musculoskeletal Systems

Identification of muscle-tendon force generation properties and muscle activities from physiological measurements, e.g., motion data and raw surface electromyography (sEMG), offers opportunities to construct a subject-specific musculoskeletal (MSK) digital twin system for health condition assessment and motion prediction. While machine learning approaches with capabilities in extracting complex features and patterns from a large amount of data have been applied to motion prediction given sEMG signals, the learned data-driven mapping is black-box and may not satisfy the underlying physics and has reduced generality. In this work, we propose a feature-encoded physics-informed parameter identification neural network (FEPI-PINN) for simultaneous prediction of motion and parameter identification of human MSK systems. In this approach, features of high-dimensional noisy sEMG signals are projected onto a low-dimensional noise-filtered embedding space for the enhancement of forwarding dynamics prediction. This FEPI-PINN model can be trained to relate sEMG signals to joint motion and simultaneously identify key MSK parameters. The numerical examples demonstrate that the proposed framework can effectively identify subject-specific muscle parameters and the trained physics-informed forward-dynamics surrogate yields accurate motion predictions of elbow flexion-extension motion that are in good agreement with the measured joint motion data.