1
|
Bottemanne H, Mouchabac S, Gauld C. Reshaping computational neuropsychiatry beyond synaptopathy. Brain 2025; 148:1526-1530. [PMID: 39873478 DOI: 10.1093/brain/awaf031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2024] [Revised: 12/30/2024] [Accepted: 01/11/2025] [Indexed: 01/30/2025] Open
Abstract
Computational neuropsychiatry is a leading discipline in explaining psychopathology in terms of neuronal message passing, distributed processing and belief propagation in neuronal networks. Active Inference (AI) is a way of representing this dysfunctional signal processing. According to the AI approach, all neuronal processing and action selection can be explained by maximizing Bayesian model evidence or minimizing variational free energy. Following these principles, it has been suggested that dysconnection in neuronal networks results in aberrant belief updating and erroneous inference, leading to psychiatric and neurologic symptoms. However, there is a classic distinction between disorders of inference (or synaptopathy-including the majority of psychiatric disorders) and disorders of brain function (including vascular neurological pathologies and severe forms of tauopathy and synucleinopathies). This distinction is generally based on the idea that synaptopathies impair neuromodulatory precision weighting, leading to rigid inferences or heightened sensitivity to noise, while disorders of brain function are linked to damage in the nervous system (disconnection). This makes it challenging to apply the logic of the free energy principle. We suggest that this distinction will enable future models of neuropsychiatric symptoms to be improved by considering more than neuronal message passing.
Collapse
Affiliation(s)
- Hugo Bottemanne
- MOODS Team, INSERM 1018, CESP (Centre de Recherche en Epidémiologie et Santé des Populations), Université Paris-Saclay, Faculté de Médecine Paris-Saclay, Kremlin Bicêtre 94270, France
- Department of Psychiatry, Bicêtre Hospital, Mood Center Paris Saclay, DMU Neurosciences, Paris-Saclay University, Assistance Publique-Hôpitaux de Paris (AP-HP), Kremlin Bicêtre 94270, France
- Institut du Cerveau-Paris Brain Institute, Institut National de la Santé et de la Recherche Médicale (INSERM) U1127, iCrin, Centre National de la Recherche Scientifique (CNRS), Paris 75013, France
| | - Stephane Mouchabac
- Institut du Cerveau-Paris Brain Institute, Institut National de la Santé et de la Recherche Médicale (INSERM) U1127, iCrin, Centre National de la Recherche Scientifique (CNRS), Paris 75013, France
- Department of Psychiatry, Saint Antoine Hospital, DMU Neurosciences, Sorbonne University, Assistance Publique-Hôpitaux de Paris (AP-HP), Paris 75012, France
| | - Christophe Gauld
- Department of Child and Adolescent Psychopathology, CHU de Lyon, F-69000 Lyon, France
- Institut des Sciences Cognitives Marc Jeannerod, UMR 5229 CNRS & Université Claude Bernard Lyon 1, F-69000 Lyon, France
| |
Collapse
|
2
|
Wu S, Huang H, Wang S, Chen G, Zhou C, Yang D. Neural heterogeneity enhances reliable neural information processing: Local sensitivity and globally input-slaved transient dynamics. SCIENCE ADVANCES 2025; 11:eadr3903. [PMID: 40173217 PMCID: PMC11963962 DOI: 10.1126/sciadv.adr3903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2024] [Accepted: 02/26/2025] [Indexed: 04/04/2025]
Abstract
Cortical neuronal activity varies over time and across repeated trials, yet consistently represents stimulus features. The dynamical mechanism underlying this reliable representation and computation remains elusive. This study uncovers a mechanism for reliable neural information processing, leveraging a biologically plausible network model incorporating neural heterogeneity. First, we investigate neuronal timescale diversity, revealing that it disrupts intrinsic coherent spatiotemporal patterns, induces firing rate heterogeneity, enhances local responsive sensitivity, and aligns network activity closely with input. The system exhibits globally input-slaved transient dynamics, essential for reliable neural information processing. Other neural heterogeneities, such as nonuniform input connections, spike threshold heterogeneity, and network in-degree heterogeneity, play similar roles, highlighting the importance of neural heterogeneity in shaping consistent stimulus representation. This mechanism offers a potentially general framework for understanding neural heterogeneity in reliable computation and informs the design of reservoir computing models endowed with liquid wave reservoirs for neuromorphic computing.
Collapse
Affiliation(s)
- Shengdun Wu
- Research Centre for Frontier Fundamental Studies, Zhejiang Lab, Hangzhou 311100, China
| | - Haiping Huang
- PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, China
| | - Shengjun Wang
- Department of Physics, Shaanxi Normal University, Xi’an 710119, China
| | - Guozhang Chen
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, China
| | - Changsong Zhou
- Department of Physics, Hong Kong Baptist University, Kowloon Tong, Hong Kong, China
| | - Dongping Yang
- Research Centre for Frontier Fundamental Studies, Zhejiang Lab, Hangzhou 311100, China
| |
Collapse
|
3
|
Friston KJ, Salvatori T, Isomura T, Tschantz A, Kiefer A, Verbelen T, Koudahl M, Paul A, Parr T, Razi A, Kagan BJ, Buckley CL, Ramstead MJD. Active Inference and Intentional Behavior. Neural Comput 2025; 37:666-700. [PMID: 40030135 DOI: 10.1162/neco_a_01738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Accepted: 11/04/2024] [Indexed: 03/19/2025]
Abstract
Recent advances in theoretical biology suggest that key definitions of basal cognition and sentient behavior may arise as emergent properties of in vitro cell cultures and neuronal networks. Such neuronal networks reorganize activity to demonstrate structured behaviors when embodied in structured information landscapes. In this article, we characterize this kind of self-organization through the lens of the free energy principle, that is, as self-evidencing. We do this by first discussing the definitions of reactive and sentient behavior in the setting of active inference, which describes the behavior of agents that model the consequences of their actions. We then introduce a formal account of intentional behavior that describes agents as driven by a preferred end point or goal in latent state-spaces. We then investigate these forms of (reactive, sentient, and intentional) behavior using simulations. First, we simulate the in vitro experiments, in which neuronal cultures modulated activity to improve gameplay in a simplified version of Pong by implementing nested, free energy minimizing processes. The simulations are then used to deconstruct the ensuing predictive behavior, leading to the distinction between merely reactive, sentient, and intentional behavior with the latter formalized in terms of inductive inference. This distinction is further studied using simple machine learning benchmarks (navigation in a grid world and the Tower of Hanoi problem) that show how quickly and efficiently adaptive behavior emerges under an inductive form of active inference.
Collapse
Affiliation(s)
- Karl J Friston
- Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London WC1N 3AR, U.K
- VERSES AI Research Lab, Los Angeles, California, 90016, U.S.
| | | | - Takuya Isomura
- Brain Intelligence Theory Unit, RIKEN Center for Brain Science, Wako, Saitama, 351-0198, Japan
| | | | - Alex Kiefer
- VERSES AI Research Lab, Los Angeles, California, 90016, U.S.A.
| | - Tim Verbelen
- VERSES AI Research Lab, Los Angeles, California, 90016, U.S.A.
| | - Magnus Koudahl
- VERSES AI Research Lab, Los Angeles, California, 90016, U.S.A.
| | - Aswin Paul
- VERSES AI Research Lab, Los Angeles, California, 90016, U.S
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, VIC 3800 Australia
- IITB-Monash Research Academy, Mumbai-4000076, India
| | - Thomas Parr
- Nuffield Department of Clinical Neurosciences, University of Oxford, OX3 9DU, U.K.
| | - Adeel Razi
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, VIC 3800 Australia
- Monash Biomedical Imaging, Monash University, Clayton, VIC 3800 Australia
- CIFAR Azrieli Global Scholars Program, Toronto, ON M5G 1M1
| | | | | | - Maxwell J D Ramstead
- Queen Square Institute of Neurology, University College London, Queen Square, London, WC1N 3BG, United Kingdom
| |
Collapse
|
4
|
Rossi KL, Budzinski RC, Medeiros ES, Boaretto BRR, Muller L, Feudel U. Dynamical properties and mechanisms of metastability: A perspective in neuroscience. Phys Rev E 2025; 111:021001. [PMID: 40103058 DOI: 10.1103/physreve.111.021001] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2024] [Indexed: 03/20/2025]
Abstract
Metastability, characterized by a variability of regimes in time, is a ubiquitous type of neural dynamics. It has been formulated in many different ways in the neuroscience literature, however, which may cause some confusion. In this Perspective, we discuss metastability from the point of view of dynamical systems theory. We extract from the literature a very simple but general definition through the concept of metastable regimes as long-lived but transient epochs of activity with unique dynamical properties. This definition serves as an umbrella term that encompasses formulations from other works, and readily connects to concepts from dynamical systems theory. This allows us to examine general dynamical properties of metastable regimes, propose in a didactic manner several dynamics-based mechanisms that generate them, and discuss a theoretical tool to characterize them quantitatively. This Perspective leads to insights that help to address issues debated in the literature and also suggests pathways for future research.
Collapse
Affiliation(s)
- Kalel L Rossi
- Carl von Ossietzky University Oldenburg, Theoretical Physics/Complex Systems, ICBM, 26129 Oldenburg, Lower Saxony, Germany
| | - Roberto C Budzinski
- Western University, Department of Mathematics and Western Institute for Neuroscience, N6A 3K7 London, Ontario, Canada
- Fields Institute, Fields Lab for Network Science, M5T 3J1 Toronto, Ontario, Canada
| | - Everton S Medeiros
- São Paulo State University (UNESP), Institute of Geosciences and Exact Sciences, Avenida 24A 1515, 13506-900 Rio Claro, São Paulo, Brazil
| | - Bruno R R Boaretto
- Universidade Federal de São Paulo, Institute of Science and Technology, 12247-014 São José dos Campos, São Paulo, Brazil
- Universitat Politecnica de Catalunya, Department of Physics, 08222 Terrassa, Barcelona, Spain
| | - Lyle Muller
- Western University, Department of Mathematics and Western Institute for Neuroscience, N6A 3K7 London, Ontario, Canada
- Fields Institute, Fields Lab for Network Science, M5T 3J1 Toronto, Ontario, Canada
| | - Ulrike Feudel
- Carl von Ossietzky University Oldenburg, Theoretical Physics/Complex Systems, ICBM, 26129 Oldenburg, Lower Saxony, Germany
| |
Collapse
|
5
|
Paoli M, Haase A. In Vivo Two-Photon Imaging of the Olfactory System in Insects. Methods Mol Biol 2025; 2915:1-48. [PMID: 40249481 DOI: 10.1007/978-1-0716-4466-9_1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/19/2025]
Abstract
This chapter describes how to apply two-photon neuroimaging to study the insect olfactory system in vivo. It provides a complete protocol for insect brain functional imaging, with additional remarks on the acquisition of morphological information from the living brain. We discuss the most important choices to make when buying or building a two-photon laser scanning microscope. We illustrate different possibilities of animal preparation and brain tissue labeling for in vivo imaging. Finally, we give an overview of the main methods of image data processing and analysis, together with practical examples of pioneering applications of this imaging modality.
Collapse
Affiliation(s)
- Marco Paoli
- Neuroscience Paris-Seine - Institut de Biologie Paris-Seine, Sorbonne Université, INSERM, CNRS, Paris, France.
- Centre des Sciences du Goût et de l'Alimentation, CNRS, INRAe, Institut Agro, Université de Bourgogne, Dijon, France.
| | - Albrecht Haase
- Center for Mind/Brain Sciences and Department of Physics, University of Trento, Trento, Italy
| |
Collapse
|
6
|
Xu M, Hosokawa T, Tsutsui KI, Aihara K. Dynamic tuning of neural stability for cognitive control. Proc Natl Acad Sci U S A 2024; 121:e2409487121. [PMID: 39585987 PMCID: PMC11626131 DOI: 10.1073/pnas.2409487121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2024] [Accepted: 09/29/2024] [Indexed: 11/27/2024] Open
Abstract
The brain is thought to execute cognitive control by actively maintaining and flexibly updating patterns of neural activity that represent goals and rules. However, while actively maintaining patterns of activity requires robustness against noise and distractors, updating the activity requires sensitivity to task-relevant inputs. How these conflicting demands can be reconciled in a single neural system remains unclear. Here, we study the prefrontal cortex of monkeys maintaining a covert rule and integrating sensory inputs toward a choice. Following the onset of neural responses, sensory integration evolves with a 70 ms delay. Using a stability analysis and a recurrent neural network model trained to perform the task, we show that this delay enables a transient, system-level destabilization, opening a temporal window to selectively incorporate new information. This mechanism allows robustness and sensitivity to coexist in a neural system and hierarchically updates patterns of neural activity, providing a general framework for cognitive control. Furthermore, it reveals a learned, explicit rule representation, suggesting a reconciliation between the symbolic and connectionist approaches for building intelligent machines.
Collapse
Affiliation(s)
- Muyuan Xu
- International Research Center for Neurointelligence, The University of Tokyo, Bunkyo-ku, Tokyo113-0033, Japan
| | - Takayuki Hosokawa
- Department of Orthoptics, Faculty of Rehabilitation, Kawasaki University of Medical Welfare, Kurashiki, Okayama701-0193, Japan
| | - Ken-Ichiro Tsutsui
- Laboratory of Systems Neuroscience, Graduate School of Life Sciences, Tohoku University, Sendai, Miyagi980-8577, Japan
| | - Kazuyuki Aihara
- International Research Center for Neurointelligence, The University of Tokyo, Bunkyo-ku, Tokyo113-0033, Japan
| |
Collapse
|
7
|
Morozov A, Feudel U, Hastings A, Abbott KC, Cuddington K, Heggerud CM, Petrovskii S. Long-living transients in ecological models: Recent progress, new challenges, and open questions. Phys Life Rev 2024; 51:423-441. [PMID: 39581175 DOI: 10.1016/j.plrev.2024.11.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2024] [Accepted: 11/08/2024] [Indexed: 11/26/2024]
Abstract
Traditionally, mathematical models in ecology placed an emphasis on asymptotic, long-term dynamics. However, a large number of recent studies highlighted the importance of transient dynamics in ecological and eco-evolutionary systems, in particular 'long transients' that can last for hundreds of generations or even longer. Many models as well as empirical studies indicated that a system can function for a long time in a certain state or regime (a 'metastable regime') but later exhibits an abrupt transition to another regime not preceded by any parameter change (or following the change that occurred long before the transition). This scenario where tipping occurs without any apparent source of a regime shift is also referred to as 'metastability'. Despite considerable evidence of the presence of long transients in real-world systems as well as models, until recently research into long-living transients in ecology has remained in its infancy, largely lacking systematisation. Within the past decade, however, substantial progress has been made in creating a unifying theory of long transients in deterministic as well as stochastic systems. This has considerably accelerated further studies on long transients, in particular on those characterised by more complicated patterns and/or underlying mechanisms. The main goal of this review is to provide an overview of recent research on long transients and related regime shifts in models of ecological dynamics. We pay special attention to the role of environmental stochasticity, the effect of multiple timescales (slow-fast systems), transient spatial patterns, and relation between transients and spatial synchronisation. We also discuss current challenges and open questions in understanding transients with applications to ecosystems dynamics.
Collapse
Affiliation(s)
- Andrew Morozov
- School of Computing and Mathematical Sciences, University of Leicester, LE1 7RH, UK; Institute of Ecology and Evolution, Russian Academy of Sciences, Moscow, Russia
| | - Ulrike Feudel
- Institute for Chemistry and Biology of the Marine Environment, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| | - Alan Hastings
- Department of Environmental Science and Policy, University of California, Davis, USA; Santa Fe Institute, Santa Fe, New Mexico, USA
| | - Karen C Abbott
- Department of Biology, Case Western Reserve University, Cleveland, OH 44106, USA
| | - Kim Cuddington
- Department of Biology, University of Waterloo, Waterloo, Ontario, Canada
| | | | - Sergei Petrovskii
- School of Computing and Mathematical Sciences, Institute for Environmental Futures, University of Leicester, LE1 7RH, UK; Peoples Friendship University of Russia (RUDN University), 6 Miklukho-Maklaya Str., 117198 Moscow, Russia.
| |
Collapse
|
8
|
Rabinovich M, Bick C, Varona P. Beyond neurons and spikes: cognon, the hierarchical dynamical unit of thought. Cogn Neurodyn 2024; 18:3327-3335. [PMID: 39712132 PMCID: PMC11655723 DOI: 10.1007/s11571-023-09987-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 05/17/2023] [Accepted: 06/14/2023] [Indexed: 12/24/2024] Open
Abstract
From the dynamical point of view, most cognitive phenomena are hierarchical, transient and sequential. Such cognitive spatio-temporal processes can be represented by a set of sequential metastable dynamical states together with their associated transitions: The state is quasi-stationary close to one metastable state before a rapid transition to another state. Hence, we postulate that metastable states are the central players in cognitive information processing. Based on the analogy of quasiparticles as elementary units in physics, we introduce here the quantum of cognitive information dynamics, which we term "cognon". A cognon, or dynamical unit of thought, is represented by a robust finite chain of metastable neural states. Cognons can be organized at multiple hierarchical levels and coordinate complex cognitive information representations. Since a cognon is an abstract conceptualization, we link this abstraction to brain sequential dynamics that can be measured using common modalities and argue that cognons and brain rhythms form binding spatiotemporal complexes to keep simultaneous dynamical information which relate the 'what', 'where' and 'when'.
Collapse
Affiliation(s)
| | - Christian Bick
- Department of Mathematics, Vrije Universiteit, Amsterdam, The Netherlands
| | - Pablo Varona
- Dpto. de Ingeniería Informática, Escuela Politécnica Superior, Universidad Autónoma de Madrid, Madrid, Spain
| |
Collapse
|
9
|
Fitz H, Hagoort P, Petersson KM. Neurobiological Causal Models of Language Processing. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:225-247. [PMID: 38645618 PMCID: PMC11025648 DOI: 10.1162/nol_a_00133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 12/18/2023] [Indexed: 04/23/2024]
Abstract
The language faculty is physically realized in the neurobiological infrastructure of the human brain. Despite significant efforts, an integrated understanding of this system remains a formidable challenge. What is missing from most theoretical accounts is a specification of the neural mechanisms that implement language function. Computational models that have been put forward generally lack an explicit neurobiological foundation. We propose a neurobiologically informed causal modeling approach which offers a framework for how to bridge this gap. A neurobiological causal model is a mechanistic description of language processing that is grounded in, and constrained by, the characteristics of the neurobiological substrate. It intends to model the generators of language behavior at the level of implementational causality. We describe key features and neurobiological component parts from which causal models can be built and provide guidelines on how to implement them in model simulations. Then we outline how this approach can shed new light on the core computational machinery for language, the long-term storage of words in the mental lexicon and combinatorial processing in sentence comprehension. In contrast to cognitive theories of behavior, causal models are formulated in the "machine language" of neurobiology which is universal to human cognition. We argue that neurobiological causal modeling should be pursued in addition to existing approaches. Eventually, this approach will allow us to develop an explicit computational neurobiology of language.
Collapse
Affiliation(s)
- Hartmut Fitz
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Peter Hagoort
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Karl Magnus Petersson
- Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Faculty of Medicine and Biomedical Sciences, University of Algarve, Faro, Portugal
| |
Collapse
|
10
|
Yao J, Hou R, Fan H, Liu J, Chen Z, Hou J, Cheng Q, Li CT. Prefrontal projections modulate recurrent circuitry in the insular cortex to support short-term memory. Cell Rep 2024; 43:113756. [PMID: 38358886 DOI: 10.1016/j.celrep.2024.113756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 11/30/2023] [Accepted: 01/23/2024] [Indexed: 02/17/2024] Open
Abstract
Short-term memory (STM) maintains information during a short delay period. How long-range and local connections interact to support STM encoding remains elusive. Here, we tackle the problem focusing on long-range projections from the medial prefrontal cortex (mPFC) to the anterior agranular insular cortex (aAIC) in head-fixed mice performing an olfactory delayed-response task. Optogenetic and electrophysiological experiments reveal the behavioral importance of the two regions in encoding STM information. Spike-correlogram analysis reveals strong local and cross-region functional coupling (FC) between memory neurons encoding the same information. Optogenetic suppression of mPFC-aAIC projections during the delay period reduces behavioral performance, the proportion of memory neurons, and memory-specific FC within the aAIC, whereas optogenetic excitation enhances all of them. mPFC-aAIC projections also bidirectionally modulate the efficacy of STM-information transfer, measured by the contribution of FC spiking pairs to the memory-coding ability of following neurons. Thus, prefrontal projections modulate insular neurons' functional connectivity and memory-coding ability to support STM.
Collapse
Affiliation(s)
- Jian Yao
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China
| | - Ruiqing Hou
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Hongmei Fan
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Jiawei Liu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhaoqin Chen
- Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai 200031, China
| | - Jincan Hou
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China
| | - Qi Cheng
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China
| | - Chengyu T Li
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China; Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai 200031, China.
| |
Collapse
|
11
|
Gonzalo Cogno S, Obenhaus HA, Lautrup A, Jacobsen RI, Clopath C, Andersson SO, Donato F, Moser MB, Moser EI. Minute-scale oscillatory sequences in medial entorhinal cortex. Nature 2024; 625:338-344. [PMID: 38123682 PMCID: PMC10781645 DOI: 10.1038/s41586-023-06864-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2022] [Accepted: 11/10/2023] [Indexed: 12/23/2023]
Abstract
The medial entorhinal cortex (MEC) hosts many of the brain's circuit elements for spatial navigation and episodic memory, operations that require neural activity to be organized across long durations of experience1. Whereas location is known to be encoded by spatially tuned cell types in this brain region2,3, little is known about how the activity of entorhinal cells is tied together over time at behaviourally relevant time scales, in the second-to-minute regime. Here we show that MEC neuronal activity has the capacity to be organized into ultraslow oscillations, with periods ranging from tens of seconds to minutes. During these oscillations, the activity is further organized into periodic sequences. Oscillatory sequences manifested while mice ran at free pace on a rotating wheel in darkness, with no change in location or running direction and no scheduled rewards. The sequences involved nearly the entire cell population, and transcended epochs of immobility. Similar sequences were not observed in neighbouring parasubiculum or in visual cortex. Ultraslow oscillatory sequences in MEC may have the potential to couple neurons and circuits across extended time scales and serve as a template for new sequence formation during navigation and episodic memory formation.
Collapse
Affiliation(s)
- Soledad Gonzalo Cogno
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway.
| | - Horst A Obenhaus
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ane Lautrup
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway
| | - R Irene Jacobsen
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway
| | - Claudia Clopath
- Department of Bioengineering, Imperial College London, London, UK
| | - Sebastian O Andersson
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway
- Max Planck Institute for Brain Research, Frankfurt am Main, Germany
| | - Flavio Donato
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway
- Biozentrum Universität Basel, Basel, Switzerland
| | - May-Britt Moser
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway.
| | - Edvard I Moser
- Kavli Institute for Systems Neuroscience and Centre for Algorithms in the Cortex, Fred Kavli Building, Norwegian University of Science and Technology, Trondheim, Norway.
| |
Collapse
|
12
|
Zhang J, Ma B, Zou W. High-speed parallel processing with photonic feedforward reservoir computing. OPTICS EXPRESS 2023; 31:43920-43933. [PMID: 38178476 DOI: 10.1364/oe.505520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Accepted: 11/28/2023] [Indexed: 01/06/2024]
Abstract
High-speed photonic reservoir computing (RC) has garnered significant interest in neuromorphic computing. However, existing reservoir layer (RL) architectures mostly rely on time-delayed feedback loops and use analog-to-digital converters for offline digital processing in the implementation of the readout layer, posing inherent limitations on their speed and capabilities. In this paper, we propose a non-feedback method that utilizes the pulse broadening effect induced by optical dispersion to implement a RL. By combining the multiplication of the modulator with the summation of the pulse temporal integration of the distributed feedback-laser diode, we successfully achieve the linear regression operation of the optoelectronic analog readout layer. Our proposed fully-analog feed-forward photonic RC (FF-PhRC) system is experimentally demonstrated to be effective in chaotic signal prediction, spoken digit recognition, and MNIST classification. Additionally, using wavelength-division multiplexing, our system manages to complete parallel tasks and improve processing capability up to 10 GHz per wavelength. The present work highlights the potential of FF-PhRC as a high-performance, high-speed computing tool for real-time neuromorphic computing.
Collapse
|
13
|
Fischer B, Chemnitz M, Zhu Y, Perron N, Roztocki P, MacLellan B, Di Lauro L, Aadhi A, Rimoldi C, Falk TH, Morandotti R. Neuromorphic Computing via Fission-based Broadband Frequency Generation. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2303835. [PMID: 37786262 PMCID: PMC10724387 DOI: 10.1002/advs.202303835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/31/2023] [Indexed: 10/04/2023]
Abstract
The performance limitations of traditional computer architectures have led to the rise of brain-inspired hardware, with optical solutions gaining popularity due to the energy efficiency, high speed, and scalability of linear operations. However, the use of optics to emulate the synaptic activity of neurons has remained a challenge since the integration of nonlinear nodes is power-hungry and, thus, hard to scale. Neuromorphic wave computing offers a new paradigm for energy-efficient information processing, building upon transient and passively nonlinear interactions between optical modes in a waveguide. Here, an implementation of this concept is presented using broadband frequency conversion by coherent higher-order soliton fission in a single-mode fiber. It is shown that phase encoding on femtosecond pulses at the input, alongside frequency selection and weighting at the system output, makes transient spectro-temporal system states interpretable and allows for the energy-efficient emulation of various digital neural networks. The experiments in a compact, fully fiber-integrated setup substantiate an anticipated enhancement in computational performance with increasing system nonlinearity. The findings suggest that broadband frequency generation, accessible on-chip and in-fiber with off-the-shelf components, may challenge the traditional approach to node-based brain-inspired hardware design, ultimately leading to energy-efficient, scalable, and dependable computing with minimal optical hardware requirements.
Collapse
Affiliation(s)
- Bennet Fischer
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
- Leibniz Institute of Photonic TechnologyAlbert‐Einstein Str. 907745JenaGermany
| | - Mario Chemnitz
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
- Leibniz Institute of Photonic TechnologyAlbert‐Einstein Str. 907745JenaGermany
| | - Yi Zhu
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
| | - Nicolas Perron
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
| | - Piotr Roztocki
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
- Ki3 Photonics Technologies2547 Rue SicardMontrealQuebecH1V 2Y8Canada
| | - Benjamin MacLellan
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
| | - Luigi Di Lauro
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
| | - A. Aadhi
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
| | - Cristina Rimoldi
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
- Dipartimento di Elettronica e TelecomunicazioniPolitecnico di TorinoCorso Duca degli Abruzzi 24Torino10129Italy
| | - Tiago H. Falk
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
| | - Roberto Morandotti
- Institut National de la Recherche Scientifique – ÉnergieMatériaux et Télécommunications1650 Blvd. Lionel‐BouletVarennesQuebecJ3X1S2Canada
| |
Collapse
|
14
|
Meyer-Ortmanns H. Heteroclinic networks for brain dynamics. FRONTIERS IN NETWORK PHYSIOLOGY 2023; 3:1276401. [PMID: 38020242 PMCID: PMC10663269 DOI: 10.3389/fnetp.2023.1276401] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Accepted: 10/16/2023] [Indexed: 12/01/2023]
Abstract
Heteroclinic networks are a mathematical concept in dynamic systems theory that is suited to describe metastable states and switching events in brain dynamics. The framework is sensitive to external input and, at the same time, reproducible and robust against perturbations. Solutions of the corresponding differential equations are spatiotemporal patterns that are supposed to encode information both in space and time coordinates. We focus on the concept of winnerless competition as realized in generalized Lotka-Volterra equations and report on results for binding and chunking dynamics, synchronization on spatial grids, and entrainment to heteroclinic motion. We summarize proposals of how to design heteroclinic networks as desired in view of reproducing experimental observations from neuronal networks and discuss the subtle role of noise. The review is on a phenomenological level with possible applications to brain dynamics, while we refer to the literature for a rigorous mathematical treatment. We conclude with promising perspectives for future research.
Collapse
Affiliation(s)
- Hildegard Meyer-Ortmanns
- School of Science, Constructor University, Bremen, Germany
- Complexity Science Hub Vienna, Vienna, Austria
| |
Collapse
|
15
|
Nandan A, Koseska A. Non-asymptotic transients away from steady states determine cellular responsiveness to dynamic spatial-temporal signals. PLoS Comput Biol 2023; 19:e1011388. [PMID: 37578988 PMCID: PMC10449117 DOI: 10.1371/journal.pcbi.1011388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 08/24/2023] [Accepted: 07/25/2023] [Indexed: 08/16/2023] Open
Abstract
Majority of the theory on cell polarization and the understanding of cellular sensing and responsiveness to localized chemical cues has been based on the idea that non-polarized and polarized cell states can be represented by stable asymptotic switching between them. The existing model classes that describe the dynamics of signaling networks underlying polarization are formulated within the framework of autonomous systems. However these models do not simultaneously capture both, robust maintenance of polarized state longer than the signal duration, and retained responsiveness to signals with complex spatial-temporal distribution. Based on recent experimental evidence for criticality organization of biochemical networks, we challenge the current concepts and demonstrate that non-asymptotic signaling dynamics arising at criticality uniquely ensures optimal responsiveness to changing chemoattractant fields. We provide a framework to characterize non-asymptotic dynamics of system's state trajectories through a non-autonomous treatment of the system, further emphasizing the importance of (long) transient dynamics, as well as the necessity to change the mathematical formalism when describing biological systems that operate in changing environments.
Collapse
Affiliation(s)
- Akhilesh Nandan
- Cellular computations and learning, Max Planck Institute for Neurobiology of Behavior – caesar, Bonn, Germany
| | - Aneta Koseska
- Cellular computations and learning, Max Planck Institute for Neurobiology of Behavior – caesar, Bonn, Germany
| |
Collapse
|
16
|
Jamilpanah L, Chiolerio A, Crepaldi M, Adamatzky A, Mohseni M. Proposing magnetoimpedance effect for neuromorphic computing. Sci Rep 2023; 13:8635. [PMID: 37244978 DOI: 10.1038/s41598-023-35876-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Accepted: 05/25/2023] [Indexed: 05/29/2023] Open
Abstract
Oscillation of physical parameters in materials can result in a peak signal in the frequency spectrum of the voltage measured from the materials. This spectrum and its amplitude/frequency tunability, through the application of bias voltage or current, can be used to perform neuron-like cognitive tasks. Magnetic materials, after achieving broad distribution for data storage applications in classical Von Neumann computer architectures, are under intense investigation for their neuromorphic computing capabilities. A recent successful demonstration regards magnetisation oscillation in magnetic thin films by spin transfer or spin orbit torques accompanied by magnetoresistance (MR) effect that can give a voltage peak in the frequency spectrum of voltage with bias current dependence of both peak frequency and amplitude. Here we use classical magnetoimpedance (MI) effect in a magnetic wire to produce such a peak and manipulate its frequency and amplitude by means of the bias voltage. We applied a noise signal to a magnetic wire with high magnetic permeability and owing to the frequency dependence of the magnetic permeability we got frequency dependent impedance with a peak at the maximum permeability. Frequency dependence of the MI effect results in different changes in the voltage amplitude at each frequency when a bias voltage is applied and therefore a shift in the peak position and amplitude can be obtained. The presented method and material provide optimal features in structural simplicity, low-frequency operation (tens of MHz-order) and high robustness at different environmental conditions. Our universal approach can be applied to any system with frequency dependent bias responses.
Collapse
Affiliation(s)
- Loghman Jamilpanah
- Department of Physics, Shahid Beheshti University, Evin, Tehran, 19839, Iran.
- Laboratory for High Performance Ceramics, Empa - Swiss Federal Laboratories for Materials Science and Technology, 8600, Dübendorf, Switzerland.
| | - Alessandro Chiolerio
- Bioinspired Soft Robotics, Center for Converging Technologies, Istituto Italiano di Tecnologia, Via Morego 30, 16165, Genoa, Italy
- Electronic Design Laboratory, Center for Human Technologies, Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152, Genoa, Italy
| | - Marco Crepaldi
- Electronic Design Laboratory, Center for Human Technologies, Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152, Genoa, Italy
| | - Andrew Adamatzky
- Unconventional Computing Laboratory, University of the West of England, Coldharbour Lane, Bristol, BS16 1QY, UK
| | - Majid Mohseni
- Department of Physics, Shahid Beheshti University, Evin, Tehran, 19839, Iran.
| |
Collapse
|
17
|
Yiling Y, Shapcott K, Peter A, Klon-Lipok J, Xuhui H, Lazar A, Singer W. Robust encoding of natural stimuli by neuronal response sequences in monkey visual cortex. Nat Commun 2023; 14:3021. [PMID: 37231014 DOI: 10.1038/s41467-023-38587-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 05/08/2023] [Indexed: 05/27/2023] Open
Abstract
Parallel multisite recordings in the visual cortex of trained monkeys revealed that the responses of spatially distributed neurons to natural scenes are ordered in sequences. The rank order of these sequences is stimulus-specific and maintained even if the absolute timing of the responses is modified by manipulating stimulus parameters. The stimulus specificity of these sequences was highest when they were evoked by natural stimuli and deteriorated for stimulus versions in which certain statistical regularities were removed. This suggests that the response sequences result from a matching operation between sensory evidence and priors stored in the cortical network. Decoders trained on sequence order performed as well as decoders trained on rate vectors but the former could decode stimulus identity from considerably shorter response intervals than the latter. A simulated recurrent network reproduced similarly structured stimulus-specific response sequences, particularly once it was familiarized with the stimuli through non-supervised Hebbian learning. We propose that recurrent processing transforms signals from stationary visual scenes into sequential responses whose rank order is the result of a Bayesian matching operation. If this temporal code were used by the visual system it would allow for ultrafast processing of visual scenes.
Collapse
Affiliation(s)
- Yang Yiling
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528, Frankfurt am Main, Germany
- International Max Planck Research School (IMPRS) for Neural Circuits, 60438, Frankfurt am Main, Germany
- Faculty of Biological Sciences, Goethe-University Frankfurt am Main, 60438, Frankfurt am Main, Germany
| | - Katharine Shapcott
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528, Frankfurt am Main, Germany
- Frankfurt Institute for Advanced Studies, 60438, Frankfurt am Main, Germany
| | - Alina Peter
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528, Frankfurt am Main, Germany
- International Max Planck Research School (IMPRS) for Neural Circuits, 60438, Frankfurt am Main, Germany
- Faculty of Biological Sciences, Goethe-University Frankfurt am Main, 60438, Frankfurt am Main, Germany
| | - Johanna Klon-Lipok
- Max Planck Institute for Brain Research, 60438, Frankfurt am Main, Germany
| | - Huang Xuhui
- Intelligent Science and Technology Academy, China Aerospace Science and Industry Corporation (CASIC), 100144, Beijing, China
- Institute of Automation, Chinese Academy of Sciences, 100190, Beijing, China
| | - Andreea Lazar
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528, Frankfurt am Main, Germany
| | - Wolf Singer
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528, Frankfurt am Main, Germany.
- Frankfurt Institute for Advanced Studies, 60438, Frankfurt am Main, Germany.
- Max Planck Institute for Brain Research, 60438, Frankfurt am Main, Germany.
| |
Collapse
|
18
|
Beiran M, Meirhaeghe N, Sohn H, Jazayeri M, Ostojic S. Parametric control of flexible timing through low-dimensional neural manifolds. Neuron 2023; 111:739-753.e8. [PMID: 36640766 PMCID: PMC9992137 DOI: 10.1016/j.neuron.2022.12.016] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Revised: 09/23/2022] [Accepted: 12/08/2022] [Indexed: 01/15/2023]
Abstract
Biological brains possess an unparalleled ability to adapt behavioral responses to changing stimuli and environments. How neural processes enable this capacity is a fundamental open question. Previous works have identified two candidate mechanisms: a low-dimensional organization of neural activity and a modulation by contextual inputs. We hypothesized that combining the two might facilitate generalization and adaptation in complex tasks. We tested this hypothesis in flexible timing tasks where dynamics play a key role. Examining trained recurrent neural networks, we found that confining the dynamics to a low-dimensional subspace allowed tonic inputs to parametrically control the overall input-output transform, enabling generalization to novel inputs and adaptation to changing conditions. Reverse-engineering and theoretical analyses demonstrated that this parametric control relies on a mechanism where tonic inputs modulate the dynamics along non-linear manifolds while preserving their geometry. Comparisons with data from behaving monkeys confirmed the behavioral and neural signatures of this mechanism.
Collapse
Affiliation(s)
- Manuel Beiran
- Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure - PSL University, 75005 Paris, France; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA
| | - Nicolas Meirhaeghe
- Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France
| | - Hansem Sohn
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Mehrdad Jazayeri
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Department of Brain & Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - Srdjan Ostojic
- Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure - PSL University, 75005 Paris, France.
| |
Collapse
|
19
|
Cooray GK, Rosch RE, Friston KJ. Global dynamics of neural mass models. PLoS Comput Biol 2023; 19:e1010915. [PMID: 36763644 PMCID: PMC9949652 DOI: 10.1371/journal.pcbi.1010915] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2022] [Revised: 02/23/2023] [Accepted: 02/03/2023] [Indexed: 02/12/2023] Open
Abstract
Neural mass models are used to simulate cortical dynamics and to explain the electrical and magnetic fields measured using electro- and magnetoencephalography. Simulations evince a complex phase-space structure for these kinds of models; including stationary points and limit cycles and the possibility for bifurcations and transitions among different modes of activity. This complexity allows neural mass models to describe the itinerant features of brain dynamics. However, expressive, nonlinear neural mass models are often difficult to fit to empirical data without additional simplifying assumptions: e.g., that the system can be modelled as linear perturbations around a fixed point. In this study we offer a mathematical analysis of neural mass models, specifically the canonical microcircuit model, providing analytical solutions describing slow changes in the type of cortical activity, i.e. dynamical itinerancy. We derive a perturbation analysis up to second order of the phase flow, together with adiabatic approximations. This allows us to describe amplitude modulations in a relatively simple mathematical format providing analytic proof-of-principle for the existence of semi-stable states of cortical dynamics at the scale of a cortical column. This work allows for model inversion of neural mass models, not only around fixed points, but over regions of phase space that encompass transitions among semi or multi-stable states of oscillatory activity. Crucially, these theoretical results speak to model inversion in the context of multiple semi-stable brain states, such as the transition between interictal, pre-ictal and ictal activity in epilepsy.
Collapse
Affiliation(s)
- Gerald Kaushallye Cooray
- GOS-UCL Institute of Child Health, University College London, London, United Kingdom
- Great Ormond Street Hospital NHS Foundation Trust, London, United Kingdom
- Karolinska Institutet, Stockholm, Sweden
- * E-mail:
| | - Richard Ewald Rosch
- Great Ormond Street Hospital NHS Foundation Trust, London, United Kingdom
- The Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London, United Kingdom
- MRC Centre for Neurodevelopmental Disorders, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, United Kingdom
| | - Karl John Friston
- The Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London, United Kingdom
| |
Collapse
|
20
|
Heteroclinic cycling and extinction in May-Leonard models with demographic stochasticity. J Math Biol 2023; 86:30. [PMID: 36637504 PMCID: PMC9839821 DOI: 10.1007/s00285-022-01859-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 09/14/2022] [Accepted: 12/16/2022] [Indexed: 01/14/2023]
Abstract
May and Leonard (SIAM J Appl Math 29:243-253, 1975) introduced a three-species Lotka-Volterra type population model that exhibits heteroclinic cycling. Rather than producing a periodic limit cycle, the trajectory takes longer and longer to complete each "cycle", passing closer and closer to unstable fixed points in which one population dominates and the others approach zero. Aperiodic heteroclinic dynamics have subsequently been studied in ecological systems (side-blotched lizards; colicinogenic Escherichia coli), in the immune system, in neural information processing models ("winnerless competition"), and in models of neural central pattern generators. Yet as May and Leonard observed "Biologically, the behavior (produced by the model) is nonsense. Once it is conceded that the variables represent animals, and therefore cannot fall below unity, it is clear that the system will, after a few cycles, converge on some single population, extinguishing the other two." Here, we explore different ways of introducing discrete stochastic dynamics based on May and Leonard's ODE model, with application to ecological population dynamics, and to a neuromotor central pattern generator system. We study examples of several quantitatively distinct asymptotic behaviors, including total extinction of all species, extinction to a single species, and persistent cyclic dominance with finite mean cycle length.
Collapse
|
21
|
Melbaum S, Russo E, Eriksson D, Schneider A, Durstewitz D, Brox T, Diester I. Conserved structures of neural activity in sensorimotor cortex of freely moving rats allow cross-subject decoding. Nat Commun 2022; 13:7420. [PMID: 36456557 PMCID: PMC9715555 DOI: 10.1038/s41467-022-35115-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Accepted: 11/17/2022] [Indexed: 12/04/2022] Open
Abstract
Our knowledge about neuronal activity in the sensorimotor cortex relies primarily on stereotyped movements that are strictly controlled in experimental settings. It remains unclear how results can be carried over to less constrained behavior like that of freely moving subjects. Toward this goal, we developed a self-paced behavioral paradigm that encouraged rats to engage in different movement types. We employed bilateral electrophysiological recordings across the entire sensorimotor cortex and simultaneous paw tracking. These techniques revealed behavioral coupling of neurons with lateralization and an anterior-posterior gradient from the premotor to the primary sensory cortex. The structure of population activity patterns was conserved across animals despite the severe under-sampling of the total number of neurons and variations in electrode positions across individuals. We demonstrated cross-subject and cross-session generalization in a decoding task through alignments of low-dimensional neural manifolds, providing evidence of a conserved neuronal code.
Collapse
Affiliation(s)
- Svenja Melbaum
- Computer Vision Group, Department of Computer Science, University of Freiburg, 79110, Freiburg, Germany
- IMBIT//BrainLinks-BrainTools, University of Freiburg, Georges-Köhler-Allee 201, 79110, Freiburg, Germany
| | - Eleonora Russo
- Department of Psychiatry and Psychotherapy, University Medical Center, Johannes Gutenberg University, 55131, Mainz, Germany
- Department of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, 68159, Mannheim, Germany
| | - David Eriksson
- IMBIT//BrainLinks-BrainTools, University of Freiburg, Georges-Köhler-Allee 201, 79110, Freiburg, Germany
- Optophysiology Lab, Faculty of Biology, University of Freiburg, 79110, Freiburg, Germany
| | - Artur Schneider
- IMBIT//BrainLinks-BrainTools, University of Freiburg, Georges-Köhler-Allee 201, 79110, Freiburg, Germany
- Optophysiology Lab, Faculty of Biology, University of Freiburg, 79110, Freiburg, Germany
| | - Daniel Durstewitz
- Department of Theoretical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, 68159, Mannheim, Germany
| | - Thomas Brox
- Computer Vision Group, Department of Computer Science, University of Freiburg, 79110, Freiburg, Germany
- IMBIT//BrainLinks-BrainTools, University of Freiburg, Georges-Köhler-Allee 201, 79110, Freiburg, Germany
| | - Ilka Diester
- IMBIT//BrainLinks-BrainTools, University of Freiburg, Georges-Köhler-Allee 201, 79110, Freiburg, Germany.
- Optophysiology Lab, Faculty of Biology, University of Freiburg, 79110, Freiburg, Germany.
- Bernstein Center Freiburg, University of Freiburg, 79104, Freiburg, Germany.
| |
Collapse
|
22
|
Dudkowski D, Jaros P, Kapitaniak T. Extreme transient dynamics. CHAOS (WOODBURY, N.Y.) 2022; 32:121101. [PMID: 36587356 DOI: 10.1063/5.0131768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 11/14/2022] [Indexed: 06/17/2023]
Abstract
We study the extreme transient dynamics of four self-excited pendula coupled via the movable beam. A slight difference in the pendula lengths induces the appearance of traveling phase behavior, within which the oscillators synchronize, but the phases between the nodes change in time. We discuss various scenarios of traveling states (involving different pendula) and their properties, comparing them with classical synchronization patterns of phase-locking. The research investigates the problem of transient dynamics preceding the stabilization of the network on a final synchronous attractor, showing that the width of transient windows can become extremely long. The relation between the behavior of the system within the transient regime and its initial conditions is examined and described. Our results include both identical and non-identical pendula masses, showing that the distribution of the latter ones is related to the transients. The research performed in this paper underlines possible transient problems occurring during the analysis of the systems when the slow evolution of the dynamics can be misinterpreted as the final behavior.
Collapse
Affiliation(s)
- Dawid Dudkowski
- Division of Dynamics, Lodz University of Technology, Stefanowskiego 1/15, 90-924 Lodz, Poland
| | - Patrycja Jaros
- Division of Dynamics, Lodz University of Technology, Stefanowskiego 1/15, 90-924 Lodz, Poland
| | - Tomasz Kapitaniak
- Division of Dynamics, Lodz University of Technology, Stefanowskiego 1/15, 90-924 Lodz, Poland
| |
Collapse
|
23
|
Lara-González E, Padilla-Orozco M, Fuentes-Serrano A, Bargas J, Duhne M. Translational neuronal ensembles: Neuronal microcircuits in psychology, physiology, pharmacology and pathology. Front Syst Neurosci 2022; 16:979680. [PMID: 36090187 PMCID: PMC9449457 DOI: 10.3389/fnsys.2022.979680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Accepted: 07/27/2022] [Indexed: 11/23/2022] Open
Abstract
Multi-recording techniques show evidence that neurons coordinate their firing forming ensembles and that brain networks are made by connections between ensembles. While “canonical” microcircuits are composed of interconnected principal neurons and interneurons, it is not clear how they participate in recorded neuronal ensembles: “groups of neurons that show spatiotemporal co-activation”. Understanding synapses and their plasticity has become complex, making hard to consider all details to fill the gap between cellular-synaptic and circuit levels. Therefore, two assumptions became necessary: First, whatever the nature of the synapses these may be simplified by “functional connections”. Second, whatever the mechanisms to achieve synaptic potentiation or depression, the resultant synaptic weights are relatively stable. Both assumptions have experimental basis cited in this review, and tools to analyze neuronal populations are being developed based on them. Microcircuitry processing followed with multi-recording techniques show temporal sequences of neuronal ensembles resembling computational routines. These sequences can be aligned with the steps of behavioral tasks and behavior can be modified upon their manipulation, supporting the hypothesis that they are memory traces. In vitro, recordings show that these temporal sequences can be contained in isolated tissue of histological scale. Sequences found in control conditions differ from those recorded in pathological tissue obtained from animal disease models and those recorded after the actions of clinically useful drugs to treat disease states, setting the basis for new bioassays to test drugs with potential clinical use. These findings make the neuronal ensembles theoretical framework a dynamic neuroscience paradigm.
Collapse
Affiliation(s)
- Esther Lara-González
- División Neurociencias, Instituto de Fisiología Celular, Universidad Nacional Autónoma de México, Mexico City, Mexico
- Department of Neuroscience, Feinberg School of Medicine, Northwestern University, Chicago, IL, United States
| | - Montserrat Padilla-Orozco
- División Neurociencias, Instituto de Fisiología Celular, Universidad Nacional Autónoma de México, Mexico City, Mexico
| | - Alejandra Fuentes-Serrano
- División Neurociencias, Instituto de Fisiología Celular, Universidad Nacional Autónoma de México, Mexico City, Mexico
| | - José Bargas
- División Neurociencias, Instituto de Fisiología Celular, Universidad Nacional Autónoma de México, Mexico City, Mexico
- *Correspondence: José Bargas,
| | - Mariana Duhne
- División Neurociencias, Instituto de Fisiología Celular, Universidad Nacional Autónoma de México, Mexico City, Mexico
- Department of Neurology, University of California, San Francisco, San Francisco, CA, United States
- Mariana Duhne,
| |
Collapse
|
24
|
Oscillations and variability in neuronal systems: interplay of autonomous transient dynamics and fast deterministic fluctuations. J Comput Neurosci 2022; 50:331-355. [PMID: 35653072 DOI: 10.1007/s10827-022-00819-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 02/03/2022] [Accepted: 03/14/2022] [Indexed: 10/18/2022]
Abstract
Neuronal systems are subject to rapid fluctuations both intrinsically and externally. These fluctuations can be disruptive or constructive. We investigate the dynamic mechanisms underlying the interactions between rapidly fluctuating signals and the intrinsic properties of the target cells to produce variable and/or coherent responses. We use linearized and non-linear conductance-based models and piecewise constant (PWC) inputs with short duration pieces. The amplitude distributions of the constant pieces consist of arbitrary permutations of a baseline PWC function. In each trial within a given protocol we use one of these permutations and each protocol consists of a subset of all possible permutations, which is the only source of uncertainty in the protocol. We show that sustained oscillatory behavior can be generated in response to various forms of PWC inputs independently of whether the stable equilibria of the corresponding unperturbed systems are foci or nodes. The oscillatory voltage responses are amplified by the model nonlinearities and attenuated for conductance-based PWC inputs as compared to current-based PWC inputs, consistent with previous theoretical and experimental work. In addition, the voltage responses to PWC inputs exhibited variability across trials, which is reminiscent of the variability generated by stochastic noise (e.g., Gaussian white noise). Our analysis demonstrates that both oscillations and variability are the result of the interaction between the PWC input and the target cell's autonomous transient dynamics with little to no contribution from the dynamics in vicinities of the steady-state, and do not require input stochasticity.
Collapse
|
25
|
Safron A, Klimaj V, Hipólito I. On the Importance of Being Flexible: Dynamic Brain Networks and Their Potential Functional Significances. Front Syst Neurosci 2022; 15:688424. [PMID: 35126062 PMCID: PMC8814434 DOI: 10.3389/fnsys.2021.688424] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 11/10/2021] [Indexed: 12/14/2022] Open
Abstract
In this theoretical review, we begin by discussing brains and minds from a dynamical systems perspective, and then go on to describe methods for characterizing the flexibility of dynamic networks. We discuss how varying degrees and kinds of flexibility may be adaptive (or maladaptive) in different contexts, specifically focusing on measures related to either more disjoint or cohesive dynamics. While disjointed flexibility may be useful for assessing neural entropy, cohesive flexibility may potentially serve as a proxy for self-organized criticality as a fundamental property enabling adaptive behavior in complex systems. Particular attention is given to recent studies in which flexibility methods have been used to investigate neurological and cognitive maturation, as well as the breakdown of conscious processing under varying levels of anesthesia. We further discuss how these findings and methods might be contextualized within the Free Energy Principle with respect to the fundamentals of brain organization and biological functioning more generally, and describe potential methodological advances from this paradigm. Finally, with relevance to computational psychiatry, we propose a research program for obtaining a better understanding of ways that dynamic networks may relate to different forms of psychological flexibility, which may be the single most important factor for ensuring human flourishing.
Collapse
Affiliation(s)
- Adam Safron
- Center for Psychedelic and Consciousness Research, Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Kinsey Institute, Indiana University, Bloomington, IN, United States
- Cognitive Science Program, Indiana University, Bloomington, IN, United States
| | - Victoria Klimaj
- Cognitive Science Program, Indiana University, Bloomington, IN, United States
- Complex Networks and Systems, Informatics Department, Indiana University, Bloomington, IN, United States
| | - Inês Hipólito
- Department of Philosophy, Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| |
Collapse
|
26
|
Bogolepova I, Agapov P. Creative thinking and structural organization of cortical formations of the brain of outstanding scientists. Zh Nevrol Psikhiatr Im S S Korsakova 2022; 122:111-114. [DOI: 10.17116/jnevro2022122071111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
27
|
Abstract
We offer an account of mental health and well-being using the predictive processing framework (PPF). According to this framework, the difference between mental health and psychopathology can be located in the goodness of the predictive model as a regulator of action. What is crucial for avoiding the rigid patterns of thinking, feeling and acting associated with psychopathology is the regulation of action based on the valence of affective states. In PPF, valence is modelled as error dynamics—the change in prediction errors over time . Our aim in this paper is to show how error dynamics can account for both momentary happiness and longer term well-being. What will emerge is a new neurocomputational framework for making sense of human flourishing.
Collapse
Affiliation(s)
- Mark Miller
- Center for Consciousness and Contemplative StudiesMonash University, Melbourne, Australia
| | - Erik Rietveld
- ILLC/Department of Philosophy, University of Amsterdam, Amsterdamhe Netherlands Department of PhilosophyUniversity of Twente, Enschede, the Netherlands
| | - Julian Kiverstein
- ILLC/Department of Philosophy, University of Amsterdam, Amsterdamhe Netherlands Department of PhilosophyUniversity of Twente, Enschede, the Netherlands
| |
Collapse
|
28
|
Parker JR, Klishko AN, Prilutsky BI, Cymbalyuk GS. Asymmetric and transient properties of reciprocal activity of antagonists during the paw-shake response in the cat. PLoS Comput Biol 2021; 17:e1009677. [PMID: 34962927 PMCID: PMC8759665 DOI: 10.1371/journal.pcbi.1009677] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Revised: 01/14/2022] [Accepted: 11/22/2021] [Indexed: 12/24/2022] Open
Abstract
Mutually inhibitory populations of neurons, half-center oscillators (HCOs), are commonly involved in the dynamics of the central pattern generators (CPGs) driving various rhythmic movements. Previously, we developed a multifunctional, multistable symmetric HCO model which produced slow locomotor-like and fast paw-shake-like activity patterns. Here, we describe asymmetric features of paw-shake responses in a symmetric HCO model and test these predictions experimentally. We considered bursting properties of the two model half-centers during transient paw-shake-like responses to short perturbations during locomotor-like activity. We found that when a current pulse was applied during the spiking phase of one half-center, let’s call it #1, the consecutive burst durations (BDs) of that half-center increased throughout the paw-shake response, while BDs of the other half-center, let’s call it #2, only changed slightly. In contrast, the consecutive interburst intervals (IBIs) of half-center #1 changed little, while IBIs of half-center #2 increased. We demonstrated that this asymmetry between the half-centers depends on the phase of the locomotor-like rhythm at which the perturbation was applied. We suggest that the fast transient response reflects functional asymmetries of slow processes that underly the locomotor-like pattern; e.g., asymmetric levels of inactivation across the two half-centers for a slowly inactivating inward current. We compared model results with those of in-vivo paw-shake responses evoked in locomoting cats and found similar asymmetries. Electromyographic (EMG) BDs of anterior hindlimb muscles with flexor-related activity increased in consecutive paw-shake cycles, while BD of posterior muscles with extensor-related activity did not change, and vice versa for IBIs of anterior flexors and posterior extensors. We conclude that EMG activity patterns during paw-shaking are consistent with the proposed mechanism producing transient paw-shake-like bursting patterns found in our multistable HCO model. We suggest that the described asymmetry of paw-shaking responses could implicate a multifunctional CPG controlling both locomotion and paw-shaking. The existence of multifunctional central pattern generators (CPGs), circuits which control more than one rhythmic motor behavior, is an intriguing hypothesis. We suggest that the cat paw-shaking response could be a transient response of the locomotor CPG. Our general prediction is that this CPG is multifunctional, and in addition to the locomotor rhythm, it can generate a transient, ten-times faster, paw-shake-like response to a stimulus. In our multistable half-center oscillator (HCO) CPG model, we applied perturbations to the locomotor pattern which resulted in a transient paw-shake-like pattern that eventually returned back to the locomotor pattern. We showed that the inactivation of the slow inward current that drives the locomotor rhythm produced asymmetry of the transient flexor and extensor activity in a symmetric HCO model. To test predictions from our model about the transient nature of the paw-shake response, we compared burst durations (BDs) and interburst intervals (IBIs) of the model half-centers in consecutive cycles of paw-shake-like responses with the BD and IBI of electromyographic (EMG) activity bursts of cat hindlimb flexors and extensors recorded during a paw-shake response. In both cases, we found similar asymmetric trends in the BD and IBI throughout a paw-shake response.
Collapse
Affiliation(s)
- Jessica R. Parker
- Neuroscience Institute, Georgia State University, Atlanta, Georgia, United States of America
| | - Alexander N. Klishko
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, Georgia, United States of America
| | - Boris I. Prilutsky
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, Georgia, United States of America
- * E-mail: (BIP); (GSC)
| | - Gennady S. Cymbalyuk
- Neuroscience Institute, Georgia State University, Atlanta, Georgia, United States of America
- * E-mail: (BIP); (GSC)
| |
Collapse
|
29
|
Schittler Neves F, Timme M. Decoding complex state space trajectories for neural computing. CHAOS (WOODBURY, N.Y.) 2021; 31:123105. [PMID: 34972334 DOI: 10.1063/5.0053429] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 11/15/2021] [Indexed: 06/14/2023]
Abstract
In biological neural circuits as well as in bio-inspired information processing systems, trajectories in high-dimensional state-space encode the solutions to computational tasks performed by complex dynamical systems. Due to the high state-space dimensionality and the number of possible encoding trajectories rapidly growing with input signal dimension, decoding these trajectories constitutes a major challenge on its own, in particular, as exponentially growing (space or time) requirements for decoding would render the original computational paradigm inefficient. Here, we suggest an approach to overcome this problem. We propose an efficient decoding scheme for trajectories emerging in spiking neural circuits that exhibit linear scaling with input signal dimensionality. We focus on the dynamics near a sequence of unstable saddle states that naturally emerge in a range of physical systems and provide a novel paradigm for analog computing, for instance, in the form of heteroclinic computing. Identifying simple measures of coordinated activity (synchrony) that are commonly applicable to all trajectories representing the same percept, we design robust readouts whose sizes and time requirements increase only linearly with the system size. These results move the conceptual boundary so far hindering the implementation of heteroclinic computing in hardware and may also catalyze efficient decoding strategies in spiking neural networks in general.
Collapse
Affiliation(s)
- Fabio Schittler Neves
- Center for Advancing Electronics Dresden (CFAED) and Institute for Theoretical Physics, TU Dresden, 01062 Dresden, Germany
| | - Marc Timme
- Center for Advancing Electronics Dresden (CFAED) and Institute for Theoretical Physics, TU Dresden, 01062 Dresden, Germany
| |
Collapse
|
30
|
Revach D, Salti M. Expanding the discussion: Revision of the fundamental assumptions framing the study of the neural correlates of consciousness. Conscious Cogn 2021; 96:103229. [PMID: 34749156 DOI: 10.1016/j.concog.2021.103229] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 10/23/2021] [Accepted: 10/23/2021] [Indexed: 01/10/2023]
Abstract
The way one asks a question is shaped by a-priori assumptions and constrains the range of possible answers. We identify and test the assumptions underlying contemporary debates, models, and methodology in the study of the neural correlates of consciousness, which was framed by Crick and Koch's seminal paper (1990). These premises create a sequential and passive conception of conscious perception: it is considered the product of resolved information processing by unconscious mechanisms, produced by a singular event in time and place representing the moment of entry. The conscious percept produced is then automatically retained to be utilized by post-conscious mechanisms. Major debates in the field, such as concern the moment of entry, the all-or-none vs graded nature, and report vs no-report paradigms, are driven by the consensus on these assumptions. We show how removing these assumptions can resolve some of the debates and challenges and prompt additional questions. The potential non-sequential nature of perception suggests new ways of thinking about consciousness as a dynamic and dispersed process, and in turn about the relationship between conscious and unconscious perception. Moreover, it allows us to present a parsimonious account for conscious perception while addressing more aspects of the phenomenon.
Collapse
Affiliation(s)
- Daniel Revach
- Ben Gurion University of the Negev, Beer-Sheva 84105, Israel.
| | - Moti Salti
- Ben Gurion University of the Negev, Beer-Sheva 84105, Israel
| |
Collapse
|
31
|
Ebitz RB, Hayden BY. The population doctrine in cognitive neuroscience. Neuron 2021; 109:3055-3068. [PMID: 34416170 PMCID: PMC8725976 DOI: 10.1016/j.neuron.2021.07.011] [Citation(s) in RCA: 103] [Impact Index Per Article: 25.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 07/02/2021] [Accepted: 07/13/2021] [Indexed: 01/08/2023]
Abstract
A major shift is happening within neurophysiology: a population doctrine is drawing level with the single-neuron doctrine that has long dominated the field. Population-level ideas have so far had their greatest impact in motor neuroscience, but they hold great promise for resolving open questions in cognition as well. Here, we codify the population doctrine and survey recent work that leverages this view to specifically probe cognition. Our discussion is organized around five core concepts that provide a foundation for population-level thinking: (1) state spaces, (2) manifolds, (3) coding dimensions, (4) subspaces, and (5) dynamics. The work we review illustrates the progress and promise that population-level thinking holds for cognitive neuroscience-for delivering new insight into attention, working memory, decision-making, executive function, learning, and reward processing.
Collapse
Affiliation(s)
- R Becket Ebitz
- Department of Neurosciences, Faculté de médecine, Université de Montréal, Montréal, QC, Canada.
| | - Benjamin Y Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neuroengineering, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
32
|
Sirio Carmantini G, Schittler Neves F, Timme M, Rodrigues S. Stochastic facilitation in heteroclinic communication channels. CHAOS (WOODBURY, N.Y.) 2021; 31:093130. [PMID: 34598472 DOI: 10.1063/5.0054485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Accepted: 08/26/2021] [Indexed: 06/13/2023]
Abstract
Biological neural systems encode and transmit information as patterns of activity tracing complex trajectories in high-dimensional state spaces, inspiring alternative paradigms of information processing. Heteroclinic networks, naturally emerging in artificial neural systems, are networks of saddles in state space that provide a transparent approach to generate complex trajectories via controlled switches among interconnected saddles. External signals induce specific switching sequences, thus dynamically encoding inputs as trajectories. Recent works have focused either on computational aspects of heteroclinic networks, i.e., Heteroclinic Computing, or their stochastic properties under noise. Yet, how well such systems may transmit information remains an open question. Here, we investigate the information transmission properties of heteroclinic networks, studying them as communication channels. Choosing a tractable but representative system exhibiting a heteroclinic network, we investigate the mutual information rate (MIR) between input signals and the resulting sequences of states as the level of noise varies. Intriguingly, MIR does not decrease monotonically with increasing noise. Intermediate noise levels indeed maximize the information transmission capacity by promoting an increased yet controlled exploration of the underlying network of states. Complementing standard stochastic resonance, these results highlight the constructive effect of stochastic facilitation (i.e., noise-enhanced information transfer) on heteroclinic communication channels and possibly on more general dynamical systems exhibiting complex trajectories in state space.
Collapse
Affiliation(s)
| | - Fabio Schittler Neves
- Center for Advancing Electronics Dresden (cfaed) and Institute for Theoretical Physics, TU Dresden, 01062 Dresden, Germany
| | - Marc Timme
- Center for Advancing Electronics Dresden (cfaed) and Institute for Theoretical Physics, TU Dresden, 01062 Dresden, Germany
| | - Serafim Rodrigues
- BCAM-Basque Center for Applied Mathematics, 48009 Bilbao, Bizkaia, Spain
| |
Collapse
|
33
|
Romero-Sosa JL, Motanis H, Buonomano DV. Differential Excitability of PV and SST Neurons Results in Distinct Functional Roles in Inhibition Stabilization of Up States. J Neurosci 2021; 41:7182-7196. [PMID: 34253625 PMCID: PMC8387123 DOI: 10.1523/jneurosci.2830-20.2021] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Revised: 06/10/2021] [Accepted: 06/13/2021] [Indexed: 11/21/2022] Open
Abstract
Up states are the best studied example of an emergent neural dynamic regime. Computational models based on a single class of inhibitory neurons indicate that Up states reflect bistable dynamic systems in which positive feedback is stabilized by strong inhibition and predict a paradoxical effect in which increased drive to inhibitory neurons results in decreased inhibitory activity. To date, however, computational models have not incorporated empirically defined properties of parvalbumin (PV) and somatostatin (SST) neurons. Here we first experimentally characterized the frequency-current (F-I) curves of pyramidal (Pyr), PV, and SST neurons from mice of either sex, and confirmed a sharp difference between the threshold and slopes of PV and SST neurons. The empirically defined F-I curves were incorporated into a three-population computational model that simulated the empirically derived firing rates of pyramidal, PV, and SST neurons. Simulations revealed that the intrinsic properties were sufficient to predict that PV neurons are primarily responsible for generating the nontrivial fixed points representing Up states. Simulations and analytical methods demonstrated that while the paradoxical effect is not obligatory in a model with two classes of inhibitory neurons, it is present in most regimes. Finally, experimental tests validated predictions of the model that the Pyr ↔ PV inhibitory loop is stronger than the Pyr ↔ SST loop.SIGNIFICANCE STATEMENT Many cortical computations, such as working memory, rely on the local recurrent excitatory connections that define cortical circuit motifs. Up states are among the best studied examples of neural dynamic regimes that rely on recurrent excitatory excitation. However, this positive feedback must be held in check by inhibition. To address the relative contribution of PV and SST neurons, we characterized the intrinsic input-output differences between these classes of inhibitory neurons and, using experimental and theoretical methods, show that the higher threshold and gain of PV leads to a dominant role in network stabilization.
Collapse
Affiliation(s)
- Juan L Romero-Sosa
- Department of Neurobiology, Integrative Center for Learning and Memory, University of California, Los Angeles, Los Angeles, California 90095
- Department of Psychology, University of California, Los Angeles, Los Angeles, California 90095
| | - Helen Motanis
- Department of Neurobiology, Integrative Center for Learning and Memory, University of California, Los Angeles, Los Angeles, California 90095
- Department of Neurosurgery, University of California, Los Angeles, Los Angeles, California 90095
| | - Dean V Buonomano
- Department of Neurobiology, Integrative Center for Learning and Memory, University of California, Los Angeles, Los Angeles, California 90095
- Department of Psychology, University of California, Los Angeles, Los Angeles, California 90095
| |
Collapse
|
34
|
Abstract
Significant experimental, computational, and theoretical work has identified rich structure within the coordinated activity of interconnected neural populations. An emerging challenge now is to uncover the nature of the associated computations, how they are implemented, and what role they play in driving behavior. We term this computation through neural population dynamics. If successful, this framework will reveal general motifs of neural population activity and quantitatively describe how neural population dynamics implement computations necessary for driving goal-directed behavior. Here, we start with a mathematical primer on dynamical systems theory and analytical tools necessary to apply this perspective to experimental data. Next, we highlight some recent discoveries resulting from successful application of dynamical systems. We focus on studies spanning motor control, timing, decision-making, and working memory. Finally, we briefly discuss promising recent lines of investigation and future directions for the computation through neural population dynamics framework.
Collapse
Affiliation(s)
- Saurabh Vyas
- Department of Bioengineering, Stanford University, Stanford, California 94305, USA; .,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA
| | - Matthew D Golub
- Department of Electrical Engineering, Stanford University, Stanford, California 94305, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA
| | - David Sussillo
- Department of Electrical Engineering, Stanford University, Stanford, California 94305, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA.,Google AI, Google Inc., Mountain View, California 94305, USA
| | - Krishna V Shenoy
- Department of Bioengineering, Stanford University, Stanford, California 94305, USA; .,Department of Electrical Engineering, Stanford University, Stanford, California 94305, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, California 94305, USA.,Department of Neurobiology, Bio-X Institute, Neurosciences Program, and Howard Hughes Medical Institute, Stanford University, Stanford, California 94305, USA
| |
Collapse
|
35
|
Hastings A, Abbott KC, Cuddington K, Francis TB, Lai YC, Morozov A, Petrovskii S, Zeeman ML. Effects of stochasticity on the length and behaviour of ecological transients. J R Soc Interface 2021; 18:20210257. [PMID: 34229460 DOI: 10.1098/rsif.2021.0257] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
There is a growing recognition that ecological systems can spend extended periods of time far away from an asymptotic state, and that ecological understanding will therefore require a deeper appreciation for how long ecological transients arise. Recent work has defined classes of deterministic mechanisms that can lead to long transients. Given the ubiquity of stochasticity in ecological systems, a similar systematic treatment of transients that includes the influence of stochasticity is important. Stochasticity can of course promote the appearance of transient dynamics by preventing systems from settling permanently near their asymptotic state, but stochasticity also interacts with deterministic features to create qualitatively new dynamics. As such, stochasticity may shorten, extend or fundamentally change a system's transient dynamics. Here, we describe a general framework that is developing for understanding the range of possible outcomes when random processes impact the dynamics of ecological systems over realistic time scales. We emphasize that we can understand the ways in which stochasticity can either extend or reduce the lifetime of transients by studying the interactions between the stochastic and deterministic processes present, and we summarize both the current state of knowledge and avenues for future advances.
Collapse
Affiliation(s)
- Alan Hastings
- Department of Environmental Science and Policy, University of California, Davis, CA 95616, USA.,Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501, USA
| | - Karen C Abbott
- Department of Biology, Case Western Reserve University, Cleveland, OH 44106, USA
| | - Kim Cuddington
- Department of Biology, University of Waterloo, Waterloo, Ontario, Canada N2L 3G1
| | - Tessa B Francis
- Puget Sound Institute, University of Washington Tacoma, Tacoma, WA 98421, USA
| | - Ying-Cheng Lai
- School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe, AZ 85287, USA
| | - Andrew Morozov
- School of Mathematics and Actuarial Science, University of Leicester, Leicester LE1 7RH, UK.,Institute of Ecology and Evolution, Russian Academy of Sciences, Leninsky pr. 33, Moscow 117071, Russia
| | - Sergei Petrovskii
- School of Mathematics and Actuarial Science, University of Leicester, Leicester LE1 7RH, UK.,Peoples' Friendship University of Russia (RUDN University), 6 Miklukho-Maklaya Str., Moscow 117198, Russia
| | - Mary Lou Zeeman
- Department of Mathematics, Bowdoin College, Brunswick, ME 04011, USA
| |
Collapse
|
36
|
Lin X, Zou X, Ji Z, Huang T, Wu S, Mi Y. A brain-inspired computational model for spatio-temporal information processing. Neural Netw 2021; 143:74-87. [PMID: 34091238 DOI: 10.1016/j.neunet.2021.05.015] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2020] [Revised: 03/31/2021] [Accepted: 05/12/2021] [Indexed: 11/28/2022]
Abstract
Spatio-temporal information processing is fundamental in both brain functions and AI applications. Current strategies for spatio-temporal pattern recognition usually involve explicit feature extraction followed by feature aggregation, which requires a large amount of labeled data. In the present study, motivated by the subcortical visual pathway and early stages of the auditory pathway for motion and sound processing, we propose a novel brain-inspired computational model for generic spatio-temporal pattern recognition. The model consists of two modules, a reservoir module and a decision-making module. The former projects complex spatio-temporal patterns into spatially separated neural representations via its recurrent dynamics, the latter reads out neural representations via integrating information over time, and the two modules are linked together using known examples. Using synthetic data, we demonstrate that the model can extract the frequency and order information of temporal inputs. We apply the model to reproduce the looming pattern discrimination behavior as observed in experiments successfully. Furthermore, we apply the model to the gait recognition task, and demonstrate that our model accomplishes the recognition in an event-based manner and outperforms deep learning counterparts when training data is limited.
Collapse
Affiliation(s)
- Xiaohan Lin
- School of Electronics Engineering and Computer Science, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China.
| | - Xiaolong Zou
- School of Electronics Engineering and Computer Science, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China; School of Psychological and Cognitive Sciences, IDG/McGovern Institute for Brain Research, PKU-Tsinghua Center for Life Sciences, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China.
| | - Zilong Ji
- School of Electronics Engineering and Computer Science, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China; School of Psychological and Cognitive Sciences, IDG/McGovern Institute for Brain Research, PKU-Tsinghua Center for Life Sciences, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China.
| | - Tiejun Huang
- School of Electronics Engineering and Computer Science, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China.
| | - Si Wu
- School of Electronics Engineering and Computer Science, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China; School of Psychological and Cognitive Sciences, IDG/McGovern Institute for Brain Research, PKU-Tsinghua Center for Life Sciences, Peking University, No.5 Yiheyuan Road Haidian District, Beijing 100871, PR China.
| | - Yuanyuan Mi
- Center for Neurointelligence, School of Medicine, Chongqing University, No.174 Shazhengjie, Shapingba, Chongqing 400044, PR China; AI Research Center, Peng Cheng Laboratory, No.2, Xingke First Street, Nanshan District, Shenzhen 518005, PR China.
| |
Collapse
|
37
|
Frölich S, Marković D, Kiebel SJ. Neuronal Sequence Models for Bayesian Online Inference. Front Artif Intell 2021; 4:530937. [PMID: 34095815 PMCID: PMC8176225 DOI: 10.3389/frai.2021.530937] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2021] [Accepted: 04/13/2021] [Indexed: 11/13/2022] Open
Abstract
Various imaging and electrophysiological studies in a number of different species and brain regions have revealed that neuronal dynamics associated with diverse behavioral patterns and cognitive tasks take on a sequence-like structure, even when encoding stationary concepts. These neuronal sequences are characterized by robust and reproducible spatiotemporal activation patterns. This suggests that the role of neuronal sequences may be much more fundamental for brain function than is commonly believed. Furthermore, the idea that the brain is not simply a passive observer but an active predictor of its sensory input, is supported by an enormous amount of evidence in fields as diverse as human ethology and physiology, besides neuroscience. Hence, a central aspect of this review is to illustrate how neuronal sequences can be understood as critical for probabilistic predictive information processing, and what dynamical principles can be used as generators of neuronal sequences. Moreover, since different lines of evidence from neuroscience and computational modeling suggest that the brain is organized in a functional hierarchy of time scales, we will also review how models based on sequence-generating principles can be embedded in such a hierarchy, to form a generative model for recognition and prediction of sensory input. We shortly introduce the Bayesian brain hypothesis as a prominent mathematical description of how online, i.e., fast, recognition, and predictions may be computed by the brain. Finally, we briefly discuss some recent advances in machine learning, where spatiotemporally structured methods (akin to neuronal sequences) and hierarchical networks have independently been developed for a wide range of tasks. We conclude that the investigation of specific dynamical and structural principles of sequential brain activity not only helps us understand how the brain processes information and generates predictions, but also informs us about neuroscientific principles potentially useful for designing more efficient artificial neuronal networks for machine learning tasks.
Collapse
Affiliation(s)
- Sascha Frölich
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| | | | | |
Collapse
|
38
|
Nelli S, Malpani A, Boonjindasup M, Serences JT. Individual Alpha Frequency Determines the Impact of Bottom-Up Drive on Visual Processing. Cereb Cortex Commun 2021; 2:tgab032. [PMID: 34296177 PMCID: PMC8171796 DOI: 10.1093/texcom/tgab032] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Revised: 04/20/2021] [Accepted: 04/20/2021] [Indexed: 11/24/2022] Open
Abstract
Endogenous alpha oscillations propagate from higher-order to early visual cortical regions, consistent with the observed modulation of these oscillations by top-down factors. However, bottom-up manipulations also influence alpha oscillations, and little is known about how these top-down and bottom-up processes interact to impact behavior. To address this, participants performed a detection task while viewing a stimulus flickering at multiple alpha band frequencies. Bottom-up drive at a participant's endogenous alpha frequency either impaired or enhanced perception, depending on the frequency, but not amplitude, of their endogenous alpha oscillation. Fast alpha drive impaired perceptual performance in participants with faster endogenous alpha oscillations, while participants with slower oscillations displayed enhanced performance. This interaction was reflected in slower endogenous oscillatory dynamics in participants with fast alpha oscillations and more rapid dynamics in participants with slow endogenous oscillations when receiving high-frequency bottom-up drive. This central tendency may suggest that driving visual circuits at alpha band frequencies that are away from the peak alpha frequency improves perception through dynamical interactions with the endogenous oscillation. As such, studies that causally manipulate neural oscillations via exogenous stimulation should carefully consider interacting effects of bottom-up drive and endogenous oscillations on behavior.
Collapse
Affiliation(s)
- Stephanie Nelli
- Neurosciences Graduate Program, University of California, San Diego, CA 92093, USA
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK
| | | | | | - John T Serences
- Neurosciences Graduate Program, University of California, San Diego, CA 92093, USA
- Department of Psychology, San Diego, CA 92093, USA
- Kavli Institute for Brain and Mind, University of California, San Diego, CA 92093, USA
| |
Collapse
|
39
|
Rouse NA, Daltorio KA. Visualization of Stable Heteroclinic Channel-Based Movement Primitives. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3061382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
40
|
Song Z, Zhou Y, Feng J, Juusola M. Multiscale 'whole-cell' models to study neural information processing - New insights from fly photoreceptor studies. J Neurosci Methods 2021; 357:109156. [PMID: 33775669 DOI: 10.1016/j.jneumeth.2021.109156] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 03/21/2021] [Accepted: 03/23/2021] [Indexed: 11/26/2022]
Abstract
Understanding a neuron's input-output relationship is a longstanding challenge. Arguably, these signalling dynamics can be better understood if studied at three levels of analysis: computational, algorithmic and implementational (Marr, 1982). But it is difficult to integrate such analyses into a single platform that can realistically simulate neural information processing. Multiscale dynamical "whole-cell" modelling, a recent systems biology approach, makes this possible. Dynamical "whole-cell" models are computational models that aim to account for the integrated function of numerous genes or molecules to behave like virtual cells in silico. However, because constructing such models is laborious, only a couple of examples have emerged since the first one, built for Mycoplasma genitalium bacterium, was reported in 2012. Here, we review dynamic "whole-cell" neuron models for fly photoreceptors and how these have been used to study neural information processing. Specifically, we review how the models have helped uncover the mechanisms and evolutionary rules of quantal light information sampling and integration, which underlie light adaptation and further improve our understanding of insect vision.
Collapse
Affiliation(s)
- Zhuoyi Song
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), Ministry of Education, China; MOE Frontiers Center for Brain Science, Fudan University, Shanghai 200433, China; Zhangjiang Fudan International Innovation Center, Shanghai, China.
| | - Yu Zhou
- School of Computing, Engineering and Physical Sciences, University of Central Lancashire, Preston PR1 2HE, UK
| | - Jianfeng Feng
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), Ministry of Education, China; MOE Frontiers Center for Brain Science, Fudan University, Shanghai 200433, China; Zhangjiang Fudan International Innovation Center, Shanghai, China
| | - Mikko Juusola
- Department of Biomedical Science, University of Sheffield, Sheffield S10 2TN, UK; State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China.
| |
Collapse
|
41
|
Spiegler A, Abadchi JK, Mohajerani M, Jirsa VK. In silico exploration of mouse brain dynamics by focal stimulation reflects the organization of functional networks and sensory processing. Netw Neurosci 2021; 4:807-851. [PMID: 33615092 PMCID: PMC7888484 DOI: 10.1162/netn_a_00152] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Accepted: 06/08/2020] [Indexed: 12/12/2022] Open
Abstract
Resting-state functional networks such as the default mode network (DMN) dominate spontaneous brain dynamics. To date, the mechanisms linking brain structure and brain dynamics and functions in cognition, perception, and action remain unknown, mainly due to the uncontrolled and erratic nature of the resting state. Here we used a stimulation paradigm to probe the brain’s resting behavior, providing insights on state-space stability and multiplicity of network trajectories after stimulation. We performed explorations on a mouse model to map spatiotemporal brain dynamics as a function of the stimulation site. We demonstrated the emergence of known functional networks in brain responses. Several responses heavily relied on the DMN and were suggestive of the DMN playing a mechanistic role between functional networks. We probed the simulated brain responses to the stimulation of regions along the information processing chains of sensory systems from periphery up to primary sensory cortices. Moreover, we compared simulated dynamics against in vivo brain responses to optogenetic stimulation. Our results underwrite the importance of anatomical connectivity in the functional organization of brain networks and demonstrate how functionally differentiated information processing chains arise from the same system. We demonstrate how functionally differentiated information processing chains arise from the same anatomical network. The main result of the in-silico mouse brain simulations is the emergence of specific functional networks based on structural data from the mouse brain. When the brain is stimulated, for example, by sensory inputs or direct electrical stimulation, the brain initially responds with activities in specific regions. The brain’s anatomical connectivity constrains the subsequent pattern formation. We built a high-resolution mouse brain network model. The model structure originated from experimental data. We systematically explored the mouse model and investigated the simulated brain dynamics after stimulation. Known functional networks emerged in the simulated brain responses. The default mode network occurred in almost all characteristic response patterns. Simulated brain response dynamics and in-vivo response dynamics of the mouse brain to optogenetic stimulation showed similarities even without parameter tuning. Anatomical connectivity and dynamics shape the functional organization of brain networks.
Collapse
Affiliation(s)
- Andreas Spiegler
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Javad Karimi Abadchi
- Canadian Center for Behavioural Neuroscience, University of Lethbridge, Alberta, Canada
| | - Majid Mohajerani
- Canadian Center for Behavioural Neuroscience, University of Lethbridge, Alberta, Canada
| | - Viktor K Jirsa
- Institut de Neurosciences des Systèmes, UMR Inserm 1106, Aix-Marseille Université, Faculté de Médecine, Marseille, France
| |
Collapse
|
42
|
Morrison M, Kutz JN. Nonlinear control of networked dynamical systems. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING 2021; 8:174-189. [PMID: 33997094 PMCID: PMC8117950 DOI: 10.1109/tnse.2020.3032117] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
We develop a principled mathematical framework for controlling nonlinear, networked dynamical systems. Our method integrates dimensionality reduction, bifurcation theory, and emerging model discovery tools to find low-dimensional subspaces where feed-forward control can be used to manipulate a system to a desired outcome. The method leverages the fact that many high-dimensional networked systems have many fixed points, allowing for the computation of control signals that will move the system between any pair of fixed points. The sparse identification of nonlinear dynamics (SINDy) algorithm is used to fit a nonlinear dynamical system to the evolution on the dominant, low-rank subspace. This then allows us to use bifurcation theory to find collections of constant control signals that will produce the desired objective path for a prescribed outcome. Specifically, we can destabilize a given fixed point while making the target fixed point an attractor. The discovered control signals can be easily projected back to the original high-dimensional state and control space. We illustrate our nonlinear control procedure on established bistable, low-dimensional biological systems, showing how control signals are found that generate switches between the fixed points. We then demonstrate our control procedure for high-dimensional systems on random high-dimensional networks and Hopfield memory networks.
Collapse
Affiliation(s)
- Megan Morrison
- Department of Applied Mathematics, University of Washington, Seattle, WA, 98195 USA
| | - J Nathan Kutz
- Department of Applied Mathematics, University of Washington, Seattle, WA, 98195 USA
| |
Collapse
|
43
|
Taxidis J, Pnevmatikakis EA, Dorian CC, Mylavarapu AL, Arora JS, Samadian KD, Hoffberg EA, Golshani P. Differential Emergence and Stability of Sensory and Temporal Representations in Context-Specific Hippocampal Sequences. Neuron 2020; 108:984-998.e9. [PMID: 32949502 PMCID: PMC7736335 DOI: 10.1016/j.neuron.2020.08.028] [Citation(s) in RCA: 51] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Revised: 07/04/2020] [Accepted: 08/27/2020] [Indexed: 12/15/2022]
Abstract
Hippocampal spiking sequences encode external stimuli and spatiotemporal intervals, linking sequential experiences in memory, but the dynamics controlling the emergence and stability of such diverse representations remain unclear. Using two-photon calcium imaging in CA1 while mice performed an olfactory working-memory task, we recorded stimulus-specific sequences of "odor-cells" encoding olfactory stimuli followed by "time-cells" encoding time points in the ensuing delay. Odor-cells were reliably activated and retained stable fields during changes in trial structure and across days. Time-cells exhibited sparse and dynamic fields that remapped in both cases. During task training, but not in untrained task exposure, time-cell ensembles increased in size, whereas odor-cell numbers remained stable. Over days, sequences drifted to new populations with cell activity progressively converging to a field and then diverging from it. Therefore, CA1 employs distinct regimes to encode external cues versus their variable temporal relationships, which may be necessary to construct maps of sequential experiences.
Collapse
MESH Headings
- Action Potentials
- Animals
- CA1 Region, Hippocampal/chemistry
- CA1 Region, Hippocampal/cytology
- CA1 Region, Hippocampal/physiology
- Cues
- Male
- Memory, Short-Term/drug effects
- Memory, Short-Term/physiology
- Mice
- Mice, 129 Strain
- Mice, Inbred C57BL
- Mice, Transgenic
- Microscopy, Fluorescence, Multiphoton/methods
- Odorants
- Smell/drug effects
- Smell/physiology
- Time Factors
Collapse
Affiliation(s)
- Jiannis Taxidis
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA; Integrative Center for Learning and Memory, Brain Research Institute, University of California, Los Angeles, Los Angeles, CA, USA.
| | | | - Conor C Dorian
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Apoorva L Mylavarapu
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Jagmeet S Arora
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Kian D Samadian
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Emily A Hoffberg
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Peyman Golshani
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA; Integrative Center for Learning and Memory, Brain Research Institute, University of California, Los Angeles, Los Angeles, CA, USA; Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, CA, USA; West Los Angeles Veteran Affairs Medical Center, Los Angeles, CA, USA; Intellectual and Developmental Disabilities Research Center, University of California, Los Angeles, Los Angeles, CA, USA.
| |
Collapse
|
44
|
Márton CD, Schultz SR, Averbeck BB. Learning to select actions shapes recurrent dynamics in the corticostriatal system. Neural Netw 2020; 132:375-393. [PMID: 32992244 PMCID: PMC7685243 DOI: 10.1016/j.neunet.2020.09.008] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Revised: 09/03/2020] [Accepted: 09/11/2020] [Indexed: 01/03/2023]
Abstract
Learning to select appropriate actions based on their values is fundamental to adaptive behavior. This form of learning is supported by fronto-striatal systems. The dorsal-lateral prefrontal cortex (dlPFC) and the dorsal striatum (dSTR), which are strongly interconnected, are key nodes in this circuitry. Substantial experimental evidence, including neurophysiological recordings, have shown that neurons in these structures represent key aspects of learning. The computational mechanisms that shape the neurophysiological responses, however, are not clear. To examine this, we developed a recurrent neural network (RNN) model of the dlPFC-dSTR circuit and trained it on an oculomotor sequence learning task. We compared the activity generated by the model to activity recorded from monkey dlPFC and dSTR in the same task. This network consisted of a striatal component which encoded action values, and a prefrontal component which selected appropriate actions. After training, this system was able to autonomously represent and update action values and select actions, thus being able to closely approximate the representational structure in corticostriatal recordings. We found that learning to select the correct actions drove action-sequence representations further apart in activity space, both in the model and in the neural data. The model revealed that learning proceeds by increasing the distance between sequence-specific representations. This makes it more likely that the model will select the appropriate action sequence as learning develops. Our model thus supports the hypothesis that learning in networks drives the neural representations of actions further apart, increasing the probability that the network generates correct actions as learning proceeds. Altogether, this study advances our understanding of how neural circuit dynamics are involved in neural computation, revealing how dynamics in the corticostriatal system support task learning.
Collapse
Affiliation(s)
- Christian D Márton
- Centre for Neurotechnology & Department of Bioengineering, Imperial College London, London, SW7 2AZ, UK; Laboratory of Neuropsychology, Section on Learning and Decision Making, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA.
| | - Simon R Schultz
- Centre for Neurotechnology & Department of Bioengineering, Imperial College London, London, SW7 2AZ, UK
| | - Bruno B Averbeck
- Laboratory of Neuropsychology, Section on Learning and Decision Making, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| |
Collapse
|
45
|
Fieseler C, Zimmer M, Kutz JN. Unsupervised learning of control signals and their encodings in Caenorhabditis elegans whole-brain recordings. J R Soc Interface 2020; 17:20200459. [PMID: 33292096 PMCID: PMC7811586 DOI: 10.1098/rsif.2020.0459] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Accepted: 11/12/2020] [Indexed: 01/08/2023] Open
Abstract
A major goal of computational neuroscience is to understand the relationship between synapse-level structure and network-level functionality. Caenorhabditis elegans is a model organism to probe this relationship due to the historic availability of the synaptic structure (connectome) and recent advances in whole brain calcium imaging techniques. Recent work has applied the concept of network controllability to neuronal networks, discovering some neurons that are able to drive the network to a certain state. However, previous work uses a linear model of the network dynamics, and it is unclear if the real neuronal network conforms to this assumption. Here, we propose a method to build a global, low-dimensional model of the dynamics, whereby an underlying global linear dynamical system is actuated by temporally sparse control signals. A key novelty of this method is discovering candidate control signals that the network uses to control itself. We analyse these control signals in two ways, showing they are interpretable and biologically plausible. First, these control signals are associated with transitions between behaviours, which were previously annotated via expert-generated features. Second, these signals can be predicted both from neurons previously implicated in behavioural transitions but also additional neurons previously unassociated with these behaviours. The proposed mathematical framework is generic and can be generalized to other neurosensory systems, potentially revealing transitions and their encodings in a completely unsupervised way.
Collapse
Affiliation(s)
- Charles Fieseler
- Department of Physics, University of Washington, Seattle, WA 98195, USA
| | - Manuel Zimmer
- Department of Neurobiology, University of Vienna, Althanstrasse 14, 1090 Vienna, Austria
- Research Institute of Molecular Pathology (IMP), Vienna Biocenter (VBC), Campus-Vienna-Biocenter 1, 1F030 Vienna, Austria
| | - J. Nathan Kutz
- Department of Applied Mathematics, University of Washington, Seattle, WA 98195, USA
| |
Collapse
|
46
|
Torres JJ, Baroni F, Latorre R, Varona P. Temporal discrimination from the interaction between dynamic synapses and intrinsic subthreshold oscillations. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.07.031] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
47
|
Shine JM. The thalamus integrates the macrosystems of the brain to facilitate complex, adaptive brain network dynamics. Prog Neurobiol 2020; 199:101951. [PMID: 33189781 DOI: 10.1016/j.pneurobio.2020.101951] [Citation(s) in RCA: 77] [Impact Index Per Article: 15.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2020] [Revised: 10/29/2020] [Accepted: 11/08/2020] [Indexed: 01/20/2023]
Abstract
The human brain is a complex, adaptive system comprised of billions of cells with trillions of connections. The interactions between the elements of the system oppose this seemingly limitless capacity by constraining the system's dynamic repertoire, enforcing distributed neural states that balance integration and differentiation. How this trade-off is mediated by the brain, and how the emergent, distributed neural patterns give rise to cognition and awareness, remains poorly understood. Here, I argue that the thalamus is well-placed to arbitrate the interactions between distributed neural assemblies in the cerebral cortex. Different classes of thalamocortical connections are hypothesized to promote either feed-forward or feedback processing modes in the cerebral cortex. This activity can be conceptualized as emerging dynamically from an evolving attractor landscape, with the relative engagement of distinct distributed circuits providing differing constraints over the manner in which brain state trajectories change over time. In addition, inputs to the distinct thalamic populations from the cerebellum and basal ganglia, respectively, are proposed to differentially shape the attractor landscape, and hence, the temporal evolution of cortical assemblies. The coordinated engagement of these neural macrosystems is then shown to share key characteristics with prominent models of cognition, attention and conscious awareness. In this way, the crucial role of the thalamus in mediating the distributed, multi-scale network organization of the central nervous system can be related to higher brain function.
Collapse
Affiliation(s)
- James M Shine
- Sydney Medical School, The University of Sydney, Australia
| |
Collapse
|
48
|
Jiao J, Gilchrist MA, Fefferman NH. The impact of host metapopulation structure on short-term evolutionary rescue in the face of a novel pathogenic threat. Glob Ecol Conserv 2020. [DOI: 10.1016/j.gecco.2020.e01174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022] Open
|
49
|
Binding brain dynamics building up heteroclinic networks: Comment on "The growth of cognition: Free energy minimization and the embryogenesis of cortical computation" by J.J. Wright and P.D. Bourke. Phys Life Rev 2020; 36:33-34. [PMID: 32883600 DOI: 10.1016/j.plrev.2020.08.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Accepted: 08/19/2020] [Indexed: 01/06/2023]
|
50
|
Zirkle J, Rubchinsky LL. Spike-Timing Dependent Plasticity Effect on the Temporal Patterning of Neural Synchronization. Front Comput Neurosci 2020; 14:52. [PMID: 32595464 PMCID: PMC7303326 DOI: 10.3389/fncom.2020.00052] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Accepted: 05/12/2020] [Indexed: 11/29/2022] Open
Abstract
Neural synchrony in the brain at rest is usually variable and intermittent, thus intervals of predominantly synchronized activity are interrupted by intervals of desynchronized activity. Prior studies suggested that this temporal structure of the weakly synchronous activity might be functionally significant: many short desynchronizations may be functionally different from few long desynchronizations even if the average synchrony level is the same. In this study, we used computational neuroscience methods to investigate the effects of spike-timing dependent plasticity (STDP) on the temporal patterns of synchronization in a simple model. We employed a small network of conductance-based model neurons that were connected via excitatory plastic synapses. The dynamics of this network was subjected to the time-series analysis methods used in prior experimental studies. We found that STDP could alter the synchronized dynamics in the network in several ways, depending on the time scale that plasticity acts on. However, in general, the action of STDP in the simple network considered here is to promote dynamics with short desynchronizations (i.e., dynamics reminiscent of that observed in experimental studies). Complex interplay of the cellular and synaptic dynamics may lead to the activity-dependent adjustment of synaptic strength in such a way as to facilitate experimentally observed short desynchronizations in the intermittently synchronized neural activity.
Collapse
Affiliation(s)
- Joel Zirkle
- Department of Mathematical Sciences, Indiana University Purdue University Indianapolis, Indianapolis, IN, United States
| | - Leonid L Rubchinsky
- Department of Mathematical Sciences, Indiana University Purdue University Indianapolis, Indianapolis, IN, United States.,Stark Neurosciences Research Institute, Indiana University School of Medicine, Indianapolis, IN, United States
| |
Collapse
|