1
|
Yu X, Bao H, Xu Q, Chen M, Bao B. Deep brain stimulation and lag synchronization in a memristive two-neuron network. Neural Netw 2024; 180:106728. [PMID: 39299036 DOI: 10.1016/j.neunet.2024.106728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Revised: 07/25/2024] [Accepted: 09/09/2024] [Indexed: 09/22/2024]
Abstract
In the pursuit of potential treatments for neurological disorders and the alleviation of patient suffering, deep brain stimulation (DBS) has been utilized to intervene or investigate pathological neural activities. To explore the exact mechanism of how DBS works, a memristive two-neuron network considering DBS is newly proposed in this work. This network is implemented by coupling two-dimensional Morris-Lecar neuron models and using a memristor synaptic synapse to mimic synaptic plasticity. The complex bursting activities and dynamical effects are revealed numerically through dynamical analysis. By examining the synchronous behavior, the desynchronization mechanism of the memristor synapse is uncovered. The study demonstrates that synaptic connections lead to the appearance of time-lagged or asynchrony in completely synchronized firing activities. Additionally, the memristive two-neuron network is implemented in hardware based on FPGA, and experimental results confirm the abundant neuronal electrical activities and chaotic dynamical behaviors. This work offers insights into the potential mechanisms of DBS intervention in neural networks.
Collapse
Affiliation(s)
- Xihong Yu
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou 213159, PR China
| | - Han Bao
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou 213159, PR China.
| | - Quan Xu
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou 213159, PR China
| | - Mo Chen
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou 213159, PR China
| | - Bocheng Bao
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou 213159, PR China
| |
Collapse
|
2
|
Ursino M, Pelle S, Nekka F, Robaey P, Schirru M. Valence-dependent dopaminergic modulation during reversal learning in Parkinson's disease: A neurocomputational approach. Neurobiol Learn Mem 2024; 215:107985. [PMID: 39270814 DOI: 10.1016/j.nlm.2024.107985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Revised: 08/19/2024] [Accepted: 09/06/2024] [Indexed: 09/15/2024]
Abstract
Reinforcement learning, crucial for behavior in dynamic environments, is driven by rewards and punishments, modulated by dopamine (DA) changes. This study explores the dopaminergic system's influence on learning, particularly in Parkinson's disease (PD), where medication leads to impaired adaptability. Highlighting the role of tonic DA in signaling the valence of actions, this research investigates how DA affects response vigor and decision-making in PD. DA not only influences reward and punishment learning but also indicates the cognitive effort level and risk propensity in actions, which are essential for understanding and managing PD symptoms. In this work, we adapt our existing neurocomputational model of basal ganglia (BG) to simulate two reversal learning tasks proposed by Cools et al. We first optimized a Hebb rule for both probabilistic and deterministic reversal learning, conducted a sensitivity analysis (SA) on parameters related to DA effect, and compared performances between three groups: PD-ON, PD-OFF, and control subjects. In our deterministic task simulation, we explored switch error rates after unexpected task switches and found a U-shaped relationship between tonic DA levels and switch error frequency. Through SA, we classify these three groups. Then, assuming that the valence of the stimulus affects the tonic levels of DA, we were able to reproduce the results by Cools et al. As for the probabilistic task simulation, our results are in line with clinical data, showing similar trends with PD-ON, characterized by higher tonic DA levels that are correlated with increased difficulty in both acquisition and reversal tasks. Our study proposes a new hypothesis: valence, signaled by tonic DA levels, influences learning in PD, confirming the uncorrelation between phasic and tonic DA changes. This hypothesis challenges existing paradigms and opens new avenues for understanding cognitive processes in PD, particularly in reversal learning tasks.
Collapse
Affiliation(s)
- Mauro Ursino
- Department of Electrical, Electronic and Information Engineering Guglielmo Marconi, University of Bologna, Campus of Cesena, I 47521 Cesena, Italy.
| | - Silvana Pelle
- Department of Electrical, Electronic and Information Engineering Guglielmo Marconi, University of Bologna, Campus of Cesena, I 47521 Cesena, Italy.
| | - Fahima Nekka
- Faculté de Pharmacie, Université de Montréal, Montreal, Quebec H3T 1J4, Canada; Centre de recherches mathématiques, Université de Montréal, Montreal, Quebec H3T 1J4, Canada; Centre for Applied Mathematics in Bioscience and Medicine (CAMBAM), McGill University, Montreal, Quebec H3G 1Y6, Canada.
| | - Philippe Robaey
- Children's Hospital of Eastern Ontario, University of Ottawa, Ottawa, ON, Canada.
| | - Miriam Schirru
- Department of Electrical, Electronic and Information Engineering Guglielmo Marconi, University of Bologna, Campus of Cesena, I 47521 Cesena, Italy; Faculté de Pharmacie, Université de Montréal, Montreal, Quebec H3T 1J4, Canada.
| |
Collapse
|
3
|
Gong B, Wang J, Cai G, Xu P, Chang S, Zhang Z, Liu C, Deng B, Wei X. Scalable Multi-Hierarchy Embedded Platform for Neural Population Simulations. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2024; 18:16-26. [PMID: 37527295 DOI: 10.1109/tbcas.2023.3300267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/03/2023]
Abstract
Brain-inspired structured neural circuits are the cornerstones of both computational and perceived intelligence. Real-time simulations of large-scale high-dimensional neural populations with complex nonlinearities pose a significant challenge. Taking advantage of distributed computations using embedded multi-cores, we propose an ARM-based scalable multi-hierarchy parallel computing platform (EmPaas) for neural population simulations. EmPaas is constructed using 340 ARM Cortex-M4 microprocessors to achieve high-speed and high-accuracy parallel computing. The tree-two-dimensional grid-like hybrid topology completes the overall construction, reducing communication strain and power consumption. As an instance of embedded computing, the optimized model for a biologically plausible basal ganglia-thalamus (BG-TH) network is deployed into this platform to verify the performance. At an operating frequency of 168 MHz, the BG-TH network consisting of 4000 Izhikevich neurons is simulated in the platform for 3000 ms with a power consumption of 56.565 mW per core and an actual time of 2748.57 ms, which shows the parallel computing approach significantly improves computational efficiency. EmPaas can meet the requirement of real-time performance with the maximum amount of 2000 Izhikevich neurons loaded in each Extended Community Unit (ECUnit), which provides a new practical method for research in large-scale brain network simulation and brain-inspired computing.
Collapse
|
4
|
Jiang Z, Liu Z, Chen L, Tong L, Zhang X, Lan X, Crookes D, Yang MH, Zhou H. Detecting and Tracking of Multiple Mice Using Part Proposal Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:9806-9820. [PMID: 35349456 DOI: 10.1109/tnnls.2022.3160800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The study of mouse social behaviors has been increasingly undertaken in neuroscience research. However, automated quantification of mouse behaviors from the videos of interacting mice is still a challenging problem, where object tracking plays a key role in locating mice in their living spaces. Artificial markers are often applied for multiple mice tracking, which are intrusive and consequently interfere with the movements of mice in a dynamic environment. In this article, we propose a novel method to continuously track several mice and individual parts without requiring any specific tagging. First, we propose an efficient and robust deep-learning-based mouse part detection scheme to generate part candidates. Subsequently, we propose a novel Bayesian-inference integer linear programming (BILP) model that jointly assigns the part candidates to individual targets with necessary geometric constraints while establishing pair-wise association between the detected parts. There is no publicly available dataset in the research community that provides a quantitative test bed for part detection and tracking of multiple mice, and we here introduce a new challenging Multi-Mice PartsTrack dataset that is made of complex behaviors. Finally, we evaluate our proposed approach against several baselines on our new datasets, where the results show that our method outperforms the other state-of-the-art approaches in terms of accuracy. We also demonstrate the generalization ability of the proposed approach on tracking zebra and locust.
Collapse
|
5
|
Sun Y, Lü J, Zhou Y, Liu Y, Chai Y. Suppression of beta oscillations by delayed feedback in a cortex-basal ganglia-thalamus-pedunculopontine nucleus neural loop model. J Biol Phys 2023; 49:463-482. [PMID: 37572243 PMCID: PMC10651615 DOI: 10.1007/s10867-023-09641-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 07/28/2023] [Indexed: 08/14/2023] Open
Abstract
Excessive neural synchronization of neural populations in the beta (β) frequency range (12-35 Hz) is intimately related to the symptoms of hypokinesia in Parkinson's disease (PD). Studies have shown that delayed feedback stimulation strategies can interrupt excessive neural synchronization and effectively alleviate symptoms associated with PD dyskinesia. Work on optimizing delayed feedback algorithms continues to progress, yet it remains challenging to further improve the inhibitory effect with reduced energy expenditure. Therefore, we first established a neural mass model of the cortex-basal ganglia-thalamus-pedunculopontine nucleus (CBGTh-PPN) closed-loop system, which can reflect the internal properties of cortical and basal ganglia neurons and their intrinsic connections with thalamic and pedunculopontine nucleus neurons. Second, the inhibitory effects of three delayed feedback schemes based on the external globus pallidum (GPe) on β oscillations were investigated separately and compared with those based on the subthalamic nucleus (STN) only. Our results show that all four delayed feedback schemes achieve effective suppression of pathological β oscillations when using the linear delayed feedback algorithm. The comparison revealed that the three GPe-based delayed feedback stimulation strategies were able to have a greater range of oscillation suppression with reduced energy consumption, thus improving control performance effectively, suggesting that they may be more effective for the relief of Parkinson's motor symptoms in practical applications.
Collapse
Affiliation(s)
- Yuqin Sun
- School of Mathematics and Physics, Shanghai University of Electric Power, Shanghai, 201306, China
| | - Jiali Lü
- School of Mathematics and Physics, Shanghai University of Electric Power, Shanghai, 201306, China
| | - Ye Zhou
- School of Mathematics and Physics, Shanghai University of Electric Power, Shanghai, 201306, China
| | - Yingpeng Liu
- School of Mathematics and Physics, Shanghai University of Electric Power, Shanghai, 201306, China
| | - Yuan Chai
- School of Mathematics and Physics, Shanghai University of Electric Power, Shanghai, 201306, China.
| |
Collapse
|
6
|
Gong B, Wang J, Lu M, Meng G, Sun K, Chang S, Zhang Z, Wei X. BrainS: Customized multi-core embedded multiple scale neuromorphic system. Neural Netw 2023; 165:381-392. [PMID: 37329782 DOI: 10.1016/j.neunet.2023.05.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 05/07/2023] [Accepted: 05/21/2023] [Indexed: 06/19/2023]
Abstract
Research on modeling and mechanisms of the brain remains the most urgent and challenging task. The customized embedded neuromorphic system is one of the most effective approaches for multi-scale simulations ranging from ion channel to network. This paper proposes BrainS, a scalable multi-core embedded neuromorphic system capable of accommodating massive and large-scale simulations. It is designed with rich external extension interfaces to support various types of input/output and communication requirements. The 3D mesh-based topology with an efficient memory access mechanism makes exploring the properties of neuronal networks possible. BrainS operates at 168 MHz and contains a model database ranging from ion channel to network scale within the Fundamental Computing Unit (FCU). At the ion channel scale, the Basic Community Unit (BCU) can perform real-time simulations of a Hodgkin-Huxley (HH) neuron with 16000 ion channels, using 125.54 KB of the SRAM. When the number of ion channels is within 64000, the HH neuron is simulated in real-time by 4 BCUs. At the network scale, the basal ganglia-thalamus (BG-TH) network consisting of 3200 Izhikevich neurons, providing a vital motor regulation function, is simulated in 4 BCUs with a power consumption of 364.8 mW. Overall, BrainS has an excellent performance in real-time and flexible configurability, providing an embedded application solution for multi-scale simulation.
Collapse
Affiliation(s)
- Bo Gong
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China.
| | - Jiang Wang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Meili Lu
- School of Information Technology Engineering, Tianjin University of Technology and Education, Tianjin, 300222, China
| | - Gong Meng
- Beijing Aerospace Automatic Control Institute, Beijing, 100854, China
| | - Kai Sun
- Beijing Aerospace Automatic Control Institute, Beijing, 100854, China
| | - Siyuan Chang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Zhen Zhang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Xile Wei
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China.
| |
Collapse
|
7
|
Yu H, Meng Z, Li H, Liu C, Wang J. Intensity-Varied Closed-Loop Noise Stimulation for Oscillation Suppression in the Parkinsonian State. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:9861-9870. [PMID: 34398769 DOI: 10.1109/tcyb.2021.3079100] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
This work explores the effectiveness of the intensity-varied closed-loop noise stimulation on the oscillation suppression in the Parkinsonian state. Deep brain stimulation (DBS) is the standard therapy for Parkinson's disease (PD), but its effects need to be improved. The noise stimulation has compelling results in alleviating the PD state. However, in the open-loop control scheme, the noise stimulation parameters cannot be self-adjusted to adapt to the amplitude of the synchronized neuronal activities in real time. Thus, based on the delayed-feedback control algorithm, an intensity-varied closed-loop noise stimulation strategy is proposed. Based on a computational model of the basal ganglia (BG) that can present the intrinsic properties of the BG neurons and their interactions with the thalamic neurons, the proposed stimulation strategy is tested. Simulation results show that the noise stimulation suppresses the pathological beta (12-35 Hz) oscillations without any new rhythms in other bands compared with traditional high-frequency DBS. The intensity-varied closed-loop noise stimulation has a more profound role in removing the pathological beta oscillations and improving the thalamic reliability than open-loop noise stimulation, especially for different PD states. And the closed-loop noise stimulation enlarges the parameter space of the delayed-feedback control algorithm due to the randomness of noise signals. We also provide a theoretical analysis of the effective parameter domain of the delayed-feedback control algorithm by simplifying the BG model to an oscillator model. This exploration may guide a new approach to treating PD by optimizing the noise-induced improvement of the BG dysfunction.
Collapse
|
8
|
Oscillation suppression effects of intermittent noisy deep brain stimulation induced by coordinated reset pattern based on a computational model. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103466] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
9
|
Liu C, Zhao G, Meng Z, Zhou C, Zhu X, Zhang W, Wang J, Li H, Wu H, Fietkiewicz C, Loparo KA. Closing the loop of DBS using the beta oscillations in cortex. Cogn Neurodyn 2021; 15:1157-1167. [PMID: 34790273 DOI: 10.1007/s11571-021-09690-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Revised: 04/25/2021] [Accepted: 06/05/2021] [Indexed: 10/21/2022] Open
Abstract
Cortical information has great importance to reflect the deep brain stimulation (DBS) effects for Parkinson's disease patients. Using cortical activities to feedback is an available closed-loop idea for DBS. Previous studies have demonstrated the pathological beta (12-35 Hz) cortical oscillations can be suppressed by appropriate DBS settings. Thus, here we propose to close the loop of DBS based on the beta oscillations in cortex. By modify the cortico-basal ganglia-thalamic neural loop model, more biologically realistic underlying the Parkinsonian phenomenon is approached. Stimulation results show the proposed closed-loop DBS strategy using cortical beta oscillation as feedback information has more profound roles in alleviating the pathological neural abnormality than the traditional open-loop DBS. Additionally, we compare the stimulation effects with subthalamic nucleus feedback strategy. It is shown that using cortical beta information as the feedback signals can further enlarge the control parameter space based on proportional-integral control structure with a lower energy expenditure. This work may pave the way to optimizing the DBS effects in a closed-loop arrangement.
Collapse
Affiliation(s)
- Chen Liu
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Ge Zhao
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Zihan Meng
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Changsong Zhou
- Department of Physics, Centre for Nonlinear Studies, Institute of Computational and Theoretical Studies, Hong Kong Baptist University, Kowloon Tong, Hong Kong, China
| | - Xiaodong Zhu
- Department of Neurology, Tianjin Medical University General Hospital, Tianjin, China
| | - Wei Zhang
- Department of Neurology, Tianjin Medical University General Hospital, Tianjin, China
| | - Jiang Wang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Huiyan Li
- School of Automation and Electrical Engineering, Tianjin University of Technology and Education, Tianjin, China
| | - Hao Wu
- School of Civil Engineering, Tianjin University, Tianjin, China
| | - Chris Fietkiewicz
- Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH USA
| | - Kenneth A Loparo
- Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH USA
| |
Collapse
|
10
|
Beppi C, Ribeiro Violante I, Scott G, Sandrone S. EEG, MEG and neuromodulatory approaches to explore cognition: Current status and future directions. Brain Cogn 2021; 148:105677. [PMID: 33486194 DOI: 10.1016/j.bandc.2020.105677] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2020] [Revised: 12/26/2020] [Accepted: 12/27/2020] [Indexed: 01/04/2023]
Abstract
Neural oscillations and their association with brain states and cognitive functions have been object of extensive investigation over the last decades. Several electroencephalography (EEG) and magnetoencephalography (MEG) analysis approaches have been explored and oscillatory properties have been identified, in parallel with the technical and computational advancement. This review provides an up-to-date account of how EEG/MEG oscillations have contributed to the understanding of cognition. Methodological challenges, recent developments and translational potential, along with future research avenues, are discussed.
Collapse
Affiliation(s)
- Carolina Beppi
- Neuroscience Center Zurich, University of Zurich and ETH Zurich, Zurich, Switzerland; Department of Neurology, University Hospital Zurich and University of Zurich, Zurich, Switzerland; Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland.
| | - Inês Ribeiro Violante
- Computational, Cognitive and Clinical Neuroscience Laboratory (C3NL), Department of Brain Sciences, Imperial College London, London, United Kingdom; School of Psychology, Faculty of Health and Medical Sciences, University of Surrey, Guildford, United Kingdom.
| | - Gregory Scott
- Computational, Cognitive and Clinical Neuroscience Laboratory (C3NL), Department of Brain Sciences, Imperial College London, London, United Kingdom.
| | - Stefano Sandrone
- Computational, Cognitive and Clinical Neuroscience Laboratory (C3NL), Department of Brain Sciences, Imperial College London, London, United Kingdom.
| |
Collapse
|