1
|
Olsen VK, Whitlock JR, Roudi Y. The quality and complexity of pairwise maximum entropy models for large cortical populations. PLoS Comput Biol 2024; 20:e1012074. [PMID: 38696532 DOI: 10.1371/journal.pcbi.1012074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Revised: 05/14/2024] [Accepted: 04/10/2024] [Indexed: 05/04/2024] Open
Abstract
We investigate the ability of the pairwise maximum entropy (PME) model to describe the spiking activity of large populations of neurons recorded from the visual, auditory, motor, and somatosensory cortices. To quantify this performance, we use (1) Kullback-Leibler (KL) divergences, (2) the extent to which the pairwise model predicts third-order correlations, and (3) its ability to predict the probability that multiple neurons are simultaneously active. We compare these with the performance of a model with independent neurons and study the relationship between the different performance measures, while varying the population size, mean firing rate of the chosen population, and the bin size used for binarizing the data. We confirm the previously reported excellent performance of the PME model for small population sizes N < 20. But we also find that larger mean firing rates and bin sizes generally decreases performance. The performance for larger populations were generally not as good. For large populations, pairwise models may be good in terms of predicting third-order correlations and the probability of multiple neurons being active, but still significantly worse than small populations in terms of their improvement over the independent model in KL-divergence. We show that these results are independent of the cortical area and of whether approximate methods or Boltzmann learning are used for inferring the pairwise couplings. We compared the scaling of the inferred couplings with N and find it to be well explained by the Sherrington-Kirkpatrick (SK) model, whose strong coupling regime shows a complex phase with many metastable states. We find that, up to the maximum population size studied here, the fitted PME model remains outside its complex phase. However, the standard deviation of the couplings compared to their mean increases, and the model gets closer to the boundary of the complex phase as the population size grows.
Collapse
Affiliation(s)
- Valdemar Kargård Olsen
- Kavli Institute for Systems Neuroscience, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway
| | - Jonathan R Whitlock
- Kavli Institute for Systems Neuroscience, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway
| | - Yasser Roudi
- Kavli Institute for Systems Neuroscience, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway
- Department of Mathematics, King's College London, London, United Kingdom
| |
Collapse
|
2
|
Fortel I, Zhan L, Ajilore O, Wu Y, Mackin S, Leow A. Disrupted excitation-inhibition balance in cognitively normal individuals at risk of Alzheimer's disease. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.21.554061. [PMID: 37662359 PMCID: PMC10473582 DOI: 10.1101/2023.08.21.554061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Background Sex differences impact Alzheimer's disease (AD) neuropathology, but cell-to-network level dysfunctions in the prodromal phase are unclear. Alterations in hippocampal excitation-inhibition balance (EIB) have recently been linked to early AD pathology. Objective Examine how AD risk factors (age, APOE-ɛ4, amyloid-β) relate to hippocampal EIB in cognitively normal males and females using connectome-level measures. Methods Individuals from the OASIS-3 cohort (age 42-95) were studied (N = 437), with a subset aged 65+ undergoing neuropsychological testing (N = 231). Results In absence of AD risk factors (APOE-ɛ4/Aβ+), whole-brain EIB decreases with age more significantly in males than females (p = 0.021, β = -0.007). Regression modeling including APOE-ɛ4 allele carriers (Aβ-) yielded a significant positive AGE-by-APOE interaction in the right hippocampus for females only (p = 0.013, β = 0.014), persisting with inclusion of Aβ+ individuals (p = 0.012, β = 0.014). Partial correlation analyses of neuropsychological testing showed significant associations with EIB in females: positive correlations between right hippocampal EIB with categorical fluency and whole-brain EIB with the trail-making test (p < 0.05). Conclusion Sex differences in EIB emerge during normal aging and progresses differently with AD risk. Results suggest APOE-ɛ4 disrupts hippocampal balance more than amyloid in females. Increased excitation correlates positively with neuropsychological performance in the female group, suggesting a duality in terms of potential beneficial effects prior to cognitive impairment. This underscores the translational relevance of APOE-ɛ4 related hyperexcitation in females, potentially informing therapeutic targets or early interventions to mitigate AD progression in this vulnerable population.
Collapse
Affiliation(s)
- Igor Fortel
- Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, IL
| | - Liang Zhan
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA
| | - Olusola Ajilore
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL
| | - Yichao Wu
- Department of Math, Statistics and Computer Science, University of Illinois at Chicago, Chicago, IL
| | - Scott Mackin
- Department of Psychiatry, University of California - San Francisco, San Francisco, CA
| | - Alex Leow
- Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, IL
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL
| |
Collapse
|
3
|
Fortel I, Zhan L, Ajilore O, Wu Y, Mackin S, Leow A. Disrupted Excitation-Inhibition Balance in Cognitively Normal Individuals at Risk of Alzheimer's Disease. J Alzheimers Dis 2023; 95:1449-1467. [PMID: 37718795 PMCID: PMC11260287 DOI: 10.3233/jad-230035] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/19/2023]
Abstract
BACKGROUND Sex differences impact Alzheimer's disease (AD) neuropathology, but cell-to-network level dysfunctions in the prodromal phase are unclear. Alterations in hippocampal excitation-inhibition balance (EIB) have recently been linked to early AD pathology. OBJECTIVE Examine how AD risk factors (age, APOEɛ4, amyloid-β) relate to hippocampal EIB in cognitively normal males and females using connectome-level measures. METHODS Individuals from the OASIS-3 cohort (age 42-95) were studied (N = 437), with a subset aged 65+ undergoing neuropsychological testing (N = 231). RESULTS In absence of AD risk factors (APOEɛ4/Aβ+), whole-brain EIB decreases with age more significantly in males than females (p = 0.021, β= -0.007). Regression modeling including APOEɛ4 allele carriers (Aβ-) yielded a significant positive AGE-by-APOE interaction in the right hippocampus for females only (p = 0.013, β= 0.014), persisting with inclusion of Aβ+ individuals (p = 0.012, β= 0.014). Partial correlation analyses of neuropsychological testing showed significant associations with EIB in females: positive correlations between right hippocampal EIB with categorical fluency and whole-brain EIB with the Trail Making Test (p < 0.05). CONCLUSIONS Sex differences in EIB emerge during normal aging and progresses differently with AD risk. Results suggest APOEɛ4 disrupts hippocampal balance more than amyloid in females. Increased excitation correlates positively with neuropsychological performance in the female group, suggesting a duality in terms of potential beneficial effects prior to cognitive impairment. This underscores the translational relevance of APOEɛ4 related hyperexcitation in females, potentially informing therapeutic targets or early interventions to mitigate AD progression in this vulnerable population.
Collapse
Affiliation(s)
- Igor Fortel
- Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, IL, USA
| | - Liang Zhan
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Olusola Ajilore
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA
| | - Yichao Wu
- Department of Math, Statistics and Computer Science, University of Illinois at Chicago, Chicago, IL, USA
| | - Scott Mackin
- Department of Psychiatry, University of California – San Francisco, San Francisco, CA, USA
| | - Alex Leow
- Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, IL, USA
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA
| |
Collapse
|
4
|
Fortel I, Butler M, Korthauer LE, Zhan L, Ajilore O, Sidiropoulos A, Wu Y, Driscoll I, Schonfeld D, Leow A. Inferring excitation-inhibition dynamics using a maximum entropy model unifying brain structure and function. Netw Neurosci 2022; 6:420-444. [PMID: 35733430 PMCID: PMC9205431 DOI: 10.1162/netn_a_00220] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 12/07/2021] [Indexed: 11/04/2022] Open
Abstract
Neural activity coordinated across different scales from neuronal circuits to large-scale brain networks gives rise to complex cognitive functions. Bridging the gap between micro- and macroscale processes, we present a novel framework based on the maximum entropy model to infer a hybrid resting-state structural connectome, representing functional interactions constrained by structural connectivity. We demonstrate that the structurally informed network outperforms the unconstrained model in simulating brain dynamics, wherein by constraining the inference model with the network structure we may improve the estimation of pairwise BOLD signal interactions. Further, we simulate brain network dynamics using Monte Carlo simulations with the new hybrid connectome to probe connectome-level differences in excitation-inhibition balance between apolipoprotein E (APOE)-ε4 carriers and noncarriers. Our results reveal sex differences among APOE-ε4 carriers in functional dynamics at criticality; specifically, female carriers appear to exhibit a lower tolerance to network disruptions resulting from increased excitatory interactions. In sum, the new multimodal network explored here enables analysis of brain dynamics through the integration of structure and function, providing insight into the complex interactions underlying neural activity such as the balance of excitation and inhibition.
Collapse
Affiliation(s)
- Igor Fortel
- Department of Bioengineering, University of Illinois at Chicago, Chicago, IL, USA
| | - Mitchell Butler
- Department of Bioengineering, University of Illinois at Chicago, Chicago, IL, USA
| | - Laura E. Korthauer
- Department of Psychology, University of Wisconsin–Milwaukee, Milwaukee, WI, USA
- Warren Alpert Medical School, Brown University, Providence, RI, USA
| | - Liang Zhan
- Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Olusola Ajilore
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA
| | | | - Yichao Wu
- Department of Math, Statistics, and Computer Science, University of Illinois at Chicago, Chicago, IL, USA
| | - Ira Driscoll
- Department of Psychology, University of Wisconsin–Milwaukee, Milwaukee, WI, USA
| | - Dan Schonfeld
- Department of Bioengineering, University of Illinois at Chicago, Chicago, IL, USA
- Department of Electrical and Computer Engineering, University of Illinois at Chicago, Chicago, IL, USA
| | - Alex Leow
- Department of Bioengineering, University of Illinois at Chicago, Chicago, IL, USA
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA
| |
Collapse
|
5
|
Yang C, Liu X. A Novel Neural Metric Based on Deep Boltzmann Machine. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-10810-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
6
|
The Emergence of Integrated Information, Complexity, and 'Consciousness' at Criticality. ENTROPY 2020; 22:e22030339. [PMID: 33286113 PMCID: PMC7516800 DOI: 10.3390/e22030339] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Revised: 03/06/2020] [Accepted: 03/12/2020] [Indexed: 11/16/2022]
Abstract
Integrated Information Theory (IIT) posits that integrated information ( Φ ) represents the quantity of a conscious experience. Here, the generalized Ising model was used to calculate Φ as a function of temperature in toy models of fully connected neural networks. A Monte-Carlo simulation was run on 159 normalized, random, positively weighted networks analogous to small five-node excitatory neural network motifs. Integrated information generated by this sample of small Ising models was measured across model parameter spaces. It was observed that integrated information, as an order parameter, underwent a phase transition at the critical point in the model. This critical point was demarcated by the peak of the generalized susceptibility (or variance in configuration due to temperature) of integrated information. At this critical point, integrated information was maximally receptive and responsive to perturbations of its own states. The results of this study provide evidence that Φ can capture integrated information in an empirical dataset, and display critical behavior acting as an order parameter from the generalized Ising model.
Collapse
|
7
|
Goldman JS, Tort-Colet N, di Volo M, Susin E, Bouté J, Dali M, Carlu M, Nghiem TA, Górski T, Destexhe A. Bridging Single Neuron Dynamics to Global Brain States. Front Syst Neurosci 2019; 13:75. [PMID: 31866837 PMCID: PMC6908479 DOI: 10.3389/fnsys.2019.00075] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2019] [Accepted: 11/19/2019] [Indexed: 11/13/2022] Open
Abstract
Biological neural networks produce information backgrounds of multi-scale spontaneous activity that become more complex in brain states displaying higher capacities for cognition, for instance, attentive awake versus asleep or anesthetized states. Here, we review brain state-dependent mechanisms spanning ion channel currents (microscale) to the dynamics of brain-wide, distributed, transient functional assemblies (macroscale). Not unlike how microscopic interactions between molecules underlie structures formed in macroscopic states of matter, using statistical physics, the dynamics of microscopic neural phenomena can be linked to macroscopic brain dynamics through mesoscopic scales. Beyond spontaneous dynamics, it is observed that stimuli evoke collapses of complexity, most remarkable over high dimensional, asynchronous, irregular background dynamics during consciousness. In contrast, complexity may not be further collapsed beyond synchrony and regularity characteristic of unconscious spontaneous activity. We propose that increased dimensionality of spontaneous dynamics during conscious states supports responsiveness, enhancing neural networks' emergent capacity to robustly encode information over multiple scales.
Collapse
Affiliation(s)
- Jennifer S. Goldman
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | - Núria Tort-Colet
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | - Matteo di Volo
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | - Eduarda Susin
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | - Jules Bouté
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | - Melissa Dali
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | - Mallory Carlu
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | | | - Tomasz Górski
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| | - Alain Destexhe
- Department of Integrative and Computational Neuroscience (ICN), Centre National de la Recherche Scientifique (CNRS), Paris-Saclay Institute of Neuroscience (NeuroPSI), Gif-sur-Yvette, France
| |
Collapse
|