Parameter estimation and uncertainty quantification using information geometry

The Constrained Disorder Principle Overcomes the Challenges of Methods for Assessing Uncertainty in Biological Systems

Different disciplines are developing various methods for determining and dealing with uncertainties in complex systems. The constrained disorder principle (CDP) accounts for the randomness, variability, and uncertainty that characterize biological systems and are essential for their proper function. Per the CDP, intrinsic unpredictability is mandatory for the dynamicity of biological systems under continuously changing internal and external perturbations. The present paper describes some of the parameters and challenges associated with uncertainty and randomness in biological systems and presents methods for quantifying them. Modeling biological systems necessitates accounting for the randomness, variability, and underlying uncertainty of systems in health and disease. The CDP provides a scheme for dealing with uncertainty in biological systems and sets the basis for using them. This paper presents the CDP-based second-generation artificial intelligence system that incorporates variability to improve the effectiveness of medical interventions. It describes the use of the digital pill that comprises algorithm-based personalized treatment regimens regulated by closed-loop systems based on personalized signatures of variability. The CDP provides a method for using uncertainties in complex systems in an outcome-based manner.

Inferring Stochastic Rates from Heterogeneous Snapshots of Particle Positions

Many imaging techniques for biological systems-like fixation of cells coupled with fluorescence microscopy-provide sharp spatial resolution in reporting locations of individuals at a single moment in time but also destroy the dynamics they intend to capture. These snapshot observations contain no information about individual trajectories, but still encode information about movement and demographic dynamics, especially when combined with a well-motivated biophysical model. The relationship between spatially evolving populations and single-moment representations of their collective locations is well-established with partial differential equations (PDEs) and their inverse problems. However, experimental data is commonly a set of locations whose number is insufficient to approximate a continuous-in-space PDE solution. Here, motivated by popular subcellular imaging data of gene expression, we embrace the stochastic nature of the data and investigate the mathematical foundations of parametrically inferring demographic rates from snapshots of particles undergoing birth, diffusion, and death in a nuclear or cellular domain. Toward inference, we rigorously derive a connection between individual particle paths and their presentation as a Poisson spatial process. Using this framework, we investigate the properties of the resulting inverse problem and study factors that affect quality of inference. One pervasive feature of this experimental regime is the presence of cell-to-cell heterogeneity. Rather than being a hindrance, we show that cell-to-cell geometric heterogeneity can increase the quality of inference on dynamics for certain parameter regimes. Altogether, the results serve as a basis for more detailed investigations of subcellular spatial patterns of RNA molecules and other stochastically evolving populations that can only be observed for single instants in their time evolution.

Inferring stochastic rates from heterogeneous snapshots of particle positions

Many imaging techniques for biological systems - like fixation of cells coupled with fluorescence microscopy - provide sharp spatial resolution in reporting locations of individuals at a single moment in time but also destroy the dynamics they intend to capture. These snapshot observations contain no information about individual trajectories, but still encode information about movement and demographic dynamics, especially when combined with a well-motivated biophysical model. The relationship between spatially evolving populations and single-moment representations of their collective locations is well-established with partial differential equations (PDEs) and their inverse problems. However, experimental data is commonly a set of locations whose number is insufficient to approximate a continuous-in-space PDE solution. Here, motivated by popular subcellular imaging data of gene expression, we embrace the stochastic nature of the data and investigate the mathematical foundations of parametrically inferring demographic rates from snapshots of particles undergoing birth, diffusion, and death in a nuclear or cellular domain. Toward inference, we rigorously derive a connection between individual particle paths and their presentation as a Poisson spatial process. Using this framework, we investigate the properties of the resulting inverse problem and study factors that affect quality of inference. One pervasive feature of this experimental regime is the presence of cell-to-cell heterogeneity. Rather than being a hindrance, we show that cell-to-cell geometric heterogeneity can increase the quality of inference on dynamics for certain parameter regimes. Altogether, the results serve as a basis for more detailed investigations of subcellular spatial patterns of RNA molecules and other stochastically evolving populations that can only be observed for single instants in their time evolution.

Parameter estimation of the fractional Ornstein-Uhlenbeck process based on quadratic variation

Modern experiments routinely produce extensive data of the diffusive dynamics of tracer particles in a large range of systems. Often, the measured diffusion turns out to deviate from the laws of Brownian motion, i.e., it is anomalous. Considerable effort has been put in conceiving methods to extract the exact parameters underlying the diffusive dynamics. Mostly, this has been done for unconfined motion of the tracer particle. Here, we consider the case when the particle is confined by an external harmonic potential, e.g., in an optical trap. The anomalous particle dynamics is described by the fractional Ornstein-Uhlenbeck process, for which we establish new estimators for the parameters. Specifically, by calculating the empirical quadratic variation of a single trajectory, we are able to recover the subordination process governing the particle motion and use it as a basis for the parameter estimation. The statistical properties of the estimators are evaluated from simulations.

Logistic tumor-population growth and ghost-points symmetry

The observed time evolution of a population is well approximated by a logistic function in many research fields, including oncology, ecology, chemistry, demography, economy, linguistics, and artificial neural networks. Initial growth is exponential at a constant rate and capped at a limit size, i.e., the carrying capacity. In mathematical oncology, the carrying capacity has been postulated to be co-evolving and thus patient-specific. As the relative tumor-over-carrying capacity ratio may be predictive and prognostic for tumor growth and treatment response dynamics, it is paramount to estimate it from limited clinical data. We show that exploiting the logistic function's rotation symmetry can help estimate the population's growth rate and carry capacity from fewer data points than conventional regression approaches. We test this novel approach against a classic oncology database of logistic tumor growth, achieving a 30% to 40% reduction in the time necessary to correctly estimate the logistic growth rate and carrying capacity. Our results will improve tumor dynamics forecasting and augment the clinical decision-making process.

Accurately summarizing an outbreak using epidemiological models takes time

Recent outbreaks of Mpox and Ebola, and worrying waves of COVID-19, influenza and respiratory syncytial virus, have all led to a sharp increase in the use of epidemiological models to estimate key epidemiological parameters. The feasibility of this estimation task is known as the practical identifiability (PI) problem. Here, we investigate the PI of eight commonly reported statistics of the classic susceptible-infectious-recovered model using a new measure that shows how much a researcher can expect to learn in a model-based Bayesian analysis of prevalence data. Our findings show that the basic reproductive number and final outbreak size are often poorly identified, with learning exceeding that of individual model parameters only in the early stages of an outbreak. The peak intensity, peak timing and initial growth rate are better identified, being in expectation over 20 times more probable having seen the data by the time the underlying outbreak peaks. We then test PI for a variety of true parameter combinations and find that PI is especially problematic in slow-growing or less-severe outbreaks. These results add to the growing body of literature questioning the reliability of inferences from epidemiological models when limited data are available.

A Continuation Technique for Maximum Likelihood Estimators in Biological Models

Estimating model parameters is a crucial step in mathematical modelling and typically involves minimizing the disagreement between model predictions and experimental data. This calibration data can change throughout a study, particularly if modelling is performed simultaneously with the calibration experiments, or during an on-going public health crisis as in the case of the COVID-19 pandemic. Consequently, the optimal parameter set, or maximal likelihood estimator (MLE), is a function of the experimental data set. Here, we develop a numerical technique to predict the evolution of the MLE as a function of the experimental data. We show that, when considering perturbations from an initial data set, our approach is significantly more computationally efficient that re-fitting model parameters while producing acceptable model fits to the updated data. We use the continuation technique to develop an explicit functional relationship between fit model parameters and experimental data that can be used to measure the sensitivity of the MLE to experimental data. We then leverage this technique to select between model fits with similar information criteria, a priori determine the experimental measurements to which the MLE is most sensitive, and suggest additional experiment measurements that can resolve parameter uncertainty.