1
|
Mitjans AG, Linares DP, Naranjo CL, Gonzalez AA, Li M, Wang Y, Reyes RG, Bringas-Vega ML, Minati L, Evans AC, Valdés-Sosa PA. Accurate and Efficient Simulation of Very High-Dimensional Neural Mass Models with Distributed-Delay Connectome Tensors. Neuroimage 2023; 274:120137. [PMID: 37116767 DOI: 10.1016/j.neuroimage.2023.120137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 04/16/2023] [Accepted: 04/25/2023] [Indexed: 04/30/2023] Open
Abstract
This paper introduces methods and a novel toolbox that efficiently integrates high-dimensional Neural Mass Models (NMMs) specified by two essential components. The first is the set of nonlinear Random Differential Equations (RDEs) of the dynamics of each neural mass. The second is the highly sparse three-dimensional Connectome Tensor (CT) that encodes the strength of the connections and the delays of information transfer along the axons of each connection. To date, simplistic assumptions prevail about delays in the CT, often assumed to be Dirac-delta functions. In reality, delays are distributed due to heterogeneous conduction velocities of the axons connecting neural masses. These distributed-delay CTs are challenging to model. Our approach implements these models by leveraging several innovations. Semi-analytical integration of RDEs is done with the Local Linearization (LL) scheme for each neural mass model, ensuring dynamical fidelity to the original continuous-time nonlinear dynamic. This semi-analytic LL integration is highly computationally-efficient. In addition, a tensor representation of the CT facilitates parallel computation. It also seamlessly allows modeling distributed delays CT with any level of complexity or realism. This ease of implementation includes models with distributed-delay CTs. Consequently, our algorithm scales linearly with the number of neural masses and the number of equations they are represented with, contrasting with more traditional methods that scale quadratically at best. To illustrate the toolbox's usefulness, we simulate a single Zetterberg-Jansen-Rit (ZJR) cortical column, a single thalmo-cortical unit, and a toy example comprising 1000 interconnected ZJR columns. These simulations demonstrate the consequences of modifying the CT, especially by introducing distributed delays. The examples illustrate the complexity of explaining EEG oscillations, e.g., split alpha peaks, since they only appear for distinct neural masses. We provide an open-source Script for the toolbox.
Collapse
Affiliation(s)
- Anisleidy González Mitjans
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Department of Mathematics, University of Havana, Havana, Cuba.
| | - Deirel Paz Linares
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Department of Neuroinformatics, Cuban Neuroscience Center, Havana, Cuba.
| | - Carlos López Naranjo
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | - Ariosky Areces Gonzalez
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Department of Informatics, University of Pinar del Rio, Pinar del Rio, Cuba.
| | - Min Li
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | - Ying Wang
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | | | - María L Bringas-Vega
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Department of Neuroinformatics, Cuban Neuroscience Center, Havana, Cuba.
| | - Ludovico Minati
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Center for Mind/Brain Sciences (CIMeC), University of Trento, 38100 Trento, Italy.
| | - Alan C Evans
- McGill Centre for Integrative Neuroscience, Ludmer Centre for Neuroinformatics and Mental Health, Montreal Neurological Institute, Canada.
| | - Pedro A Valdés-Sosa
- University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Department of Neuroinformatics, Cuban Neuroscience Center, Havana, Cuba.
| |
Collapse
|
2
|
Järvenpää M, Corander J. On predictive inference for intractable models via approximate Bayesian computation. STATISTICS AND COMPUTING 2023; 33:42. [PMID: 36785730 PMCID: PMC9911513 DOI: 10.1007/s11222-022-10163-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 10/02/2022] [Indexed: 06/18/2023]
Abstract
UNLABELLED Approximate Bayesian computation (ABC) is commonly used for parameter estimation and model comparison for intractable simulator-based statistical models whose likelihood function cannot be evaluated. In this paper we instead investigate the feasibility of ABC as a generic approximate method for predictive inference, in particular, for computing the posterior predictive distribution of future observations or missing data of interest. We consider three complementary ABC approaches for this goal, each based on different assumptions regarding which predictive density of the intractable model can be sampled from. The case where only simulation from the joint density of the observed and future data given the model parameters can be used for inference is given particular attention and it is shown that the ideal summary statistic in this setting is minimal predictive sufficient instead of merely minimal sufficient (in the ordinary sense). An ABC prediction approach that takes advantage of a certain latent variable representation is also investigated. We additionally show how common ABC sampling algorithms can be used in the predictive settings considered. Our main results are first illustrated by using simple time-series models that facilitate analytical treatment, and later by using two common intractable dynamic models. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s11222-022-10163-6.
Collapse
Affiliation(s)
- Marko Järvenpää
- Department of Biostatistics, University of Oslo, Oslo, Norway
| | - Jukka Corander
- Department of Biostatistics, University of Oslo, Oslo, Norway
- Department of Mathematics and Statistics, Helsinki Institute of Information Technology (HIIT), University of Helsinki, Helsinki, Finland
- Wellcome Sanger Institute, Hinxton, Cambridgeshire, UK
| |
Collapse
|
3
|
Schöbi D, Do CT, Frässle S, Tittgemeyer M, Heinzle J, Stephan KE. Technical note: A fast and robust integrator of delay differential equations in DCM for electrophysiological data. Neuroimage 2021; 244:118567. [PMID: 34530135 DOI: 10.1016/j.neuroimage.2021.118567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Revised: 07/05/2021] [Accepted: 09/07/2021] [Indexed: 10/20/2022] Open
Abstract
Dynamic causal models (DCMs) of electrophysiological data allow, in principle, for inference on hidden, bulk synaptic function in neural circuits. The directed influences between the neuronal elements of modeled circuits are subject to delays due to the finite transmission speed of axonal connections. Ordinary differential equations are therefore not adequate to capture the ensuing circuit dynamics, and delay differential equations (DDEs) are required instead. Previous work has illustrated that the integration of DDEs in DCMs benefits from sophisticated integration schemes in order to ensure rigorous parameter estimation and correct model identification. However, integration schemes that have been proposed for DCMs either emphasize speed (at the possible expense of accuracy) or robustness (but with computational costs that are problematic in practice). In this technical note, we propose an alternative integration scheme that overcomes these shortcomings and offers high computational efficiency while correctly preserving the nature of delayed effects. This integration scheme is available as open-source code in the Translational Algorithms for Psychiatry-Advancing Science (TAPAS) toolbox and can be easily integrated into existing software (SPM) for the analysis of DCMs for electrophysiological data. While this paper focuses on its application to the convolution-based formalism of DCMs, the new integration scheme can be equally applied to more advanced formulations of DCMs (e.g. conductance based models). Our method provides a new option for electrophysiological DCMs that offers the speed required for scientific projects, but also the accuracy required for rigorous translational applications, e.g. in computational psychiatry.
Collapse
Affiliation(s)
- Dario Schöbi
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich & Swiss Institute of Technology (ETH Zurich), Wilfriedstrasse 6, Zurich 8032, Switzerland
| | - Cao-Tri Do
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich & Swiss Institute of Technology (ETH Zurich), Wilfriedstrasse 6, Zurich 8032, Switzerland
| | - Stefan Frässle
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich & Swiss Institute of Technology (ETH Zurich), Wilfriedstrasse 6, Zurich 8032, Switzerland
| | - Marc Tittgemeyer
- Max Planck Institute for Metabolism Research, Gleuler Strasse 50, Cologne 50931, Germany; Cluster of Excellence in Cellular Stress and Aging associated Disease (CECAD), Cologne 50931, Germany
| | - Jakob Heinzle
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich & Swiss Institute of Technology (ETH Zurich), Wilfriedstrasse 6, Zurich 8032, Switzerland.
| | - Klaas Enno Stephan
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich & Swiss Institute of Technology (ETH Zurich), Wilfriedstrasse 6, Zurich 8032, Switzerland; Max Planck Institute for Metabolism Research, Gleuler Strasse 50, Cologne 50931, Germany
| |
Collapse
|
4
|
Diffusion approximation of multi-class Hawkes processes: Theoretical and numerical analysis. ADV APPL PROBAB 2021. [DOI: 10.1017/apr.2020.73] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractOscillatory systems of interacting Hawkes processes with Erlang memory kernels were introduced by Ditlevsen and Löcherbach (Stoch. Process. Appl., 2017). They are piecewise deterministic Markov processes (PDMP) and can be approximated by a stochastic diffusion. In this paper, first, a strong error bound between the PDMP and the diffusion is proved. Second, moment bounds for the resulting diffusion are derived. Third, approximation schemes for the diffusion, based on the numerical splitting approach, are proposed. These schemes are proved to converge with mean-square order 1 and to preserve the properties of the diffusion, in particular the hypoellipticity, the ergodicity, and the moment bounds. Finally, the PDMP and the diffusion are compared through numerical experiments, where the PDMP is simulated with an adapted thinning procedure.
Collapse
|
5
|
Camargo-Vargas D, Callejas-Cuervo M, Mazzoleni S. Brain-Computer Interfaces Systems for Upper and Lower Limb Rehabilitation: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:4312. [PMID: 34202546 PMCID: PMC8271710 DOI: 10.3390/s21134312] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 06/09/2021] [Accepted: 06/18/2021] [Indexed: 12/22/2022]
Abstract
In recent years, various studies have demonstrated the potential of electroencephalographic (EEG) signals for the development of brain-computer interfaces (BCIs) in the rehabilitation of human limbs. This article is a systematic review of the state of the art and opportunities in the development of BCIs for the rehabilitation of upper and lower limbs of the human body. The systematic review was conducted in databases considering using EEG signals, interface proposals to rehabilitate upper/lower limbs using motor intention or movement assistance and utilizing virtual environments in feedback. Studies that did not specify which processing system was used were excluded. Analyses of the design processing or reviews were excluded as well. It was identified that 11 corresponded to applications to rehabilitate upper limbs, six to lower limbs, and one to both. Likewise, six combined visual/auditory feedback, two haptic/visual, and two visual/auditory/haptic. In addition, four had fully immersive virtual reality (VR), three semi-immersive VR, and 11 non-immersive VR. In summary, the studies have demonstrated that using EEG signals, and user feedback offer benefits including cost, effectiveness, better training, user motivation and there is a need to continue developing interfaces that are accessible to users, and that integrate feedback techniques.
Collapse
Affiliation(s)
- Daniela Camargo-Vargas
- Software Research Group, Universidad Pedagógica y Tecnológica de Colombia, Tunja 150002, Colombia;
| | - Mauro Callejas-Cuervo
- School of Computer Science, Universidad Pedagógica y Tecnológica de Colombia, Tunja 150002, Colombia
| | - Stefano Mazzoleni
- Department of Electrical and Information Engineering, Politecnico di Bari, 70126 Bari, Italy;
| |
Collapse
|
6
|
Browning AP, Warne DJ, Burrage K, Baker RE, Simpson MJ. Identifiability analysis for stochastic differential equation models in systems biology. J R Soc Interface 2020; 17:20200652. [PMID: 33323054 PMCID: PMC7811582 DOI: 10.1098/rsif.2020.0652] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 11/24/2020] [Indexed: 12/26/2022] Open
Abstract
Mathematical models are routinely calibrated to experimental data, with goals ranging from building predictive models to quantifying parameters that cannot be measured. Whether or not reliable parameter estimates are obtainable from the available data can easily be overlooked. Such issues of parameter identifiability have important ramifications for both the predictive power of a model, and the mechanistic insight that can be obtained. Identifiability analysis is well-established for deterministic, ordinary differential equation (ODE) models, but there are no commonly adopted methods for analysing identifiability in stochastic models. We provide an accessible introduction to identifiability analysis and demonstrate how existing ideas for analysis of ODE models can be applied to stochastic differential equation (SDE) models through four practical case studies. To assess structural identifiability, we study ODEs that describe the statistical moments of the stochastic process using open-source software tools. Using practically motivated synthetic data and Markov chain Monte Carlo methods, we assess parameter identifiability in the context of available data. Our analysis shows that SDE models can often extract more information about parameters than deterministic descriptions. All code used to perform the analysis is available on Github.
Collapse
Affiliation(s)
- Alexander P. Browning
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Australia
- ARC Centre of Excellence for Mathematical and Statistical Frontiers, Queensland University of Technology, Brisbane, Australia
| | - David J. Warne
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Australia
- ARC Centre of Excellence for Mathematical and Statistical Frontiers, Queensland University of Technology, Brisbane, Australia
| | - Kevin Burrage
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Australia
- ARC Centre of Excellence for Mathematical and Statistical Frontiers, Queensland University of Technology, Brisbane, Australia
- ARC Centre of Excellence for Plant Success in Nature and Agriculture, Queensland University of Technology, Brisbane, Australia
- Department of Computer Science, University of Oxford, Oxford, UK
| | - Ruth E. Baker
- Mathematical Institute, University of Oxford, Oxford, UK
| | - Matthew J. Simpson
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Australia
- ARC Centre of Excellence for Mathematical and Statistical Frontiers, Queensland University of Technology, Brisbane, Australia
| |
Collapse
|