1
|
Yamakou ME, Kuehn C. Combined effects of spike-timing-dependent plasticity and homeostatic structural plasticity on coherence resonance. Phys Rev E 2023; 107:044302. [PMID: 37198865 DOI: 10.1103/physreve.107.044302] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 03/23/2023] [Indexed: 05/19/2023]
Abstract
Efficient processing and transfer of information in neurons have been linked to noise-induced resonance phenomena such as coherence resonance (CR), and adaptive rules in neural networks have been mostly linked to two prevalent mechanisms: spike-timing-dependent plasticity (STDP) and homeostatic structural plasticity (HSP). Thus this paper investigates CR in small-world and random adaptive networks of Hodgkin-Huxley neurons driven by STDP and HSP. Our numerical study indicates that the degree of CR strongly depends, and in different ways, on the adjusting rate parameter P, which controls STDP, on the characteristic rewiring frequency parameter F, which controls HSP, and on the parameters of the network topology. In particular, we found two robust behaviors. (i) Decreasing P (which enhances the weakening effect of STDP on synaptic weights) and decreasing F (which slows down the swapping rate of synapses between neurons) always leads to higher degrees of CR in small-world and random networks, provided that the synaptic time delay parameter τ_{c} has some appropriate values. (ii) Increasing the synaptic time delay τ_{c} induces multiple CR (MCR)-the occurrence of multiple peaks in the degree of coherence as τ_{c} changes-in small-world and random networks, with MCR becoming more pronounced at smaller values of P and F. Our results imply that STDP and HSP can jointly play an essential role in enhancing the time precision of firing necessary for optimal information processing and transfer in neural systems and could thus have applications in designing networks of noisy artificial neural circuits engineered to use CR to optimize information processing and transfer.
Collapse
Affiliation(s)
- Marius E Yamakou
- Department of Data Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Cauerstr. 11, 91058 Erlangen, Germany
- Max-Planck-Institut für Mathematik in den Naturwissenschaften, Inselstr. 22, 04103 Leipzig, Germany
| | - Christian Kuehn
- Faculty of Mathematics, Technical University of Munich, Boltzmannstrasse 3, 85748 Garching bei München, Germany
- Complexity Science Hub Vienna, Josefstädter Strasse 39, 1080 Vienna, Austria
| |
Collapse
|
2
|
Scheinker A, Cropp F, Paiagua S, Filippetto D. An adaptive approach to machine learning for compact particle accelerators. Sci Rep 2021; 11:19187. [PMID: 34584162 PMCID: PMC8478924 DOI: 10.1038/s41598-021-98785-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Accepted: 09/13/2021] [Indexed: 02/04/2023] Open
Abstract
Machine learning (ML) tools are able to learn relationships between the inputs and outputs of large complex systems directly from data. However, for time-varying systems, the predictive capabilities of ML tools degrade if the systems are no longer accurately represented by the data with which the ML models were trained. For complex systems, re-training is only possible if the changes are slow relative to the rate at which large numbers of new input-output training data can be non-invasively recorded. In this work, we present an approach to deep learning for time-varying systems that does not require re-training, but uses instead an adaptive feedback in the architecture of deep convolutional neural networks (CNN). The feedback is based only on available system output measurements and is applied in the encoded low-dimensional dense layers of the encoder-decoder CNNs. First, we develop an inverse model of a complex accelerator system to map output beam measurements to input beam distributions, while both the accelerator components and the unknown input beam distribution vary rapidly with time. We then demonstrate our method on experimental measurements of the input and output beam distributions of the HiRES ultra-fast electron diffraction (UED) beam line at Lawrence Berkeley National Laboratory, and showcase its ability for automatic tracking of the time varying photocathode quantum efficiency map. Our method can be successfully used to aid both physics and ML-based surrogate online models to provide non-invasive beam diagnostics.
Collapse
Affiliation(s)
- Alexander Scheinker
- Applied Electrodynamics Group, Los Alamos National Laboratory, Los Alamos, NM, 87545, USA.
| | - Frederick Cropp
- Department of Physics and Astronomy, University of California Los Angeles, Los Angeles, CA, 90095, USA
- Lawrence Berkeley National Laboratory, One Cyclotron Road, Berkeley, CA, 94720, USA
| | - Sergio Paiagua
- Lawrence Berkeley National Laboratory, One Cyclotron Road, Berkeley, CA, 94720, USA
| | - Daniele Filippetto
- Lawrence Berkeley National Laboratory, One Cyclotron Road, Berkeley, CA, 94720, USA
| |
Collapse
|
3
|
Nobukawa S, Wagatsuma N, Nishimura H, Doho H, Takahashi T. An Approach for Stabilizing Abnormal Neural Activity in ADHD Using Chaotic Resonance. Front Comput Neurosci 2021; 15:726641. [PMID: 34539367 PMCID: PMC8442914 DOI: 10.3389/fncom.2021.726641] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 08/09/2021] [Indexed: 12/02/2022] Open
Abstract
Reduced integrity of neural pathways from frontal to sensory cortices has been suggested as a potential neurobiological basis of attention-deficit hyperactivity disorder. Neurofeedback has been widely applied to enhance reduced neural pathways in attention-deficit hyperactivity disorder by repeated training on a daily temporal scale. Clinical and model-based studies have demonstrated that fluctuations in neural activity underpin sustained attention deficits in attention-deficit hyperactivity disorder. These aberrant neural fluctuations may be caused by the chaos–chaos intermittency state in frontal-sensory neural systems. Therefore, shifting the neural state from an aberrant chaos–chaos intermittency state to a normal stable state with an optimal external sensory stimulus, termed chaotic resonance, may be applied in neurofeedback for attention-deficit hyperactivity disorder. In this study, we applied a neurofeedback method based on chaotic resonance induced by “reduced region of orbit” feedback signals in the Baghdadi model for attention-deficit hyperactivity disorder. We evaluated the stabilizing effect of reduced region of orbit feedback and its robustness against noise from errors in estimation of neural activity. The effect of chaotic resonance successfully shifted the abnormal chaos-chaos intermittency of neural activity to the intended stable activity. Additionally, evaluation of the influence of noise due to measurement errors revealed that the efficiency of chaotic resonance induced by reduced region of orbit feedback signals was maintained over a range of certain noise strengths. In conclusion, applying chaotic resonance induced by reduced region of orbit feedback signals to neurofeedback methods may provide a promising treatment option for attention-deficit hyperactivity disorder.
Collapse
Affiliation(s)
- Sou Nobukawa
- Department of Computer Science, Chiba Institute of Technology, Chiba, Japan
| | - Nobuhiko Wagatsuma
- Department of Information Science, Faculty of Science, Toho University, Chiba, Japan
| | - Haruhiko Nishimura
- Graduate School of Applied Informatics, University of Hyogo, Kobe, Japan
| | - Hirotaka Doho
- Graduate School of Applied Informatics, University of Hyogo, Kobe, Japan.,Faculty of Education, Teacher Training Division, Kochi University, Kochi, Japan
| | - Tetsuya Takahashi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan.,Department of Neuropsychiatry, University of Fukui, Fukui, Japan.,Uozu Shinkei Sanatorium, Uozu, Japan
| |
Collapse
|
4
|
Doho H, Nobukawa S, Nishimura H, Wagatsuma N, Takahashi T. Transition of Neural Activity From the Chaotic Bipolar-Disorder State to the Periodic Healthy State Using External Feedback Signals. Front Comput Neurosci 2020; 14:76. [PMID: 32982709 PMCID: PMC7484049 DOI: 10.3389/fncom.2020.00076] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2020] [Accepted: 07/20/2020] [Indexed: 12/21/2022] Open
Abstract
Chronotherapy is a treatment for mood disorders, including major depressive disorder, mania, and bipolar disorder (BD). Neurotransmitters associated with the pathology of mood disorders exhibit circadian rhythms. A functional deficit in the neural circuits related to mood disorders disturbs the circadian rhythm; chronotherapy is an intervention that helps resynchronize the patient's biological clock with the periodic daily cycle, leading to amelioration of symptoms. In previous reports, Hadaeghi et al. proposed a non-linear dynamic model composed of the frontal and sensory cortical neural networks and the hypothalamus to explain the relationship between deficits in neural function in the frontal cortex and the disturbed circadian rhythm/mood transitions in BD (hereinafter referred to as the Hadaeghi model). In this model, neural activity in the frontal and sensory lobes exhibits periodic behavior in the healthy state; while in BD, this neural activity is in a state of chaos-chaos intermittency; this temporal departure from the healthy periodic state disturbs the circadian pacemaker in the hypothalamus. In this study, we propose an intervention based on a feedback method called the “reduced region of orbit” (RRO) method to facilitate the transition of the disturbed frontal cortical neural activity underlying BD to healthy periodic activity. Our simulation was based on the Hadaeghi model. We used an RRO feedback signal based on the return-map structure of the simulated frontal and sensory lobes to induce synchronization with a relatively weak periodic signal corresponding to the healthy condition by applying feedback of appropriate strength. The RRO feedback signal induces chaotic resonance, which facilitates the transition to healthy, periodic frontal neural activity, although this synchronization is restricted to a relatively low frequency of the periodic input signal. Additionally, applying an appropriate strength of the RRO feedback signal lowered the amplitude of the periodic input signal required to induce a synchronous state compared with the periodic signal applied alone. In conclusion, through a chaotic-resonance effect induced by the RRO feedback method, the state of the disturbed frontal neural activity characteristic of BD was transformed into a state close to healthy periodic activity by relatively weak periodic perturbations. Thus, RRO feedback-modulated chronotherapy might be an innovative new type of minimally invasive chronotherapy.
Collapse
Affiliation(s)
- Hirotaka Doho
- Faculty of Education, Teacher Training Division, Kochi University, Kochi, Japan.,Graduate School of Applied Informatics, University of Hyogo, Kobe, Japan
| | - Sou Nobukawa
- Department of Computer Science, Chiba Institute of Technology, Narashino, Japan
| | - Haruhiko Nishimura
- Graduate School of Applied Informatics, University of Hyogo, Kobe, Japan
| | - Nobuhiko Wagatsuma
- Department of Information Science, Faculty of Science, Toho University, Funabashi, Japan
| | - Tetsuya Takahashi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan.,Department of Neuropsychiatry, University of Fukui, Yoshida, Japan
| |
Collapse
|
5
|
Nobukawa S, Shibata N, Nishimura H, Doho H, Wagatsuma N, Yamanishi T. Resonance phenomena controlled by external feedback signals and additive noise in neural systems. Sci Rep 2019; 9:12630. [PMID: 31477740 PMCID: PMC6718685 DOI: 10.1038/s41598-019-48950-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2019] [Accepted: 08/16/2019] [Indexed: 12/11/2022] Open
Abstract
Chaotic resonance is a phenomenon that can replace the fluctuation source in stochastic resonance from additive noise to chaos. We previously developed a method to control the chaotic state for suitably generating chaotic resonance by external feedback even when the external adjustment of chaos is difficult, establishing a method named reduced region of orbit (RRO) feedback. However, a feedback signal was utilized only for dividing the merged attractor. In addition, the signal sensitivity in chaotic resonance induced by feedback signals and that of stochastic resonance by additive noise have not been compared. To merge the separated attractor, we propose a negative strength of the RRO feedback signal in a discrete neural system which is composed of excitatory and inhibitory neurons. We evaluate the features of chaotic resonance and compare it to stochastic resonance. The RRO feedback signal with negative strength can merge the separated attractor and induce chaotic resonance. We also confirm that additive noise induces stochastic resonance through attractor merging. The comparison of these resonance modalities verifies that chaotic resonance provides more applicability than stochastic resonance given its capability to handle attractor separation and merging.
Collapse
Affiliation(s)
- Sou Nobukawa
- Department of Computer Science, Chiba Institute of Technology, 2-17-1 Tsudanuma, Narashino, Chiba, 275-0016, Japan.
| | - Natsusaku Shibata
- Department of Computer Science, Chiba Institute of Technology, 2-17-1 Tsudanuma, Narashino, Chiba, 275-0016, Japan
| | - Haruhiko Nishimura
- Graduate School of Applied Informatics, University of Hyogo, 7-1-28 Chuo-ku, Kobe, Hyogo, 650-8588, Japan
| | - Hirotaka Doho
- Graduate School of Applied Informatics, University of Hyogo, 7-1-28 Chuo-ku, Kobe, Hyogo, 650-8588, Japan.,Faculty of Education, Teacher Training Division, Kochi University, 2-5-1 Akebono-cho, Kochi, 780-8520, Japan
| | - Nobuhiko Wagatsuma
- Faculty of Science, Department of Information Science, Toho University, 2-2-1 Miyama, Funabashi, Chiba, 274-8510, Japan
| | - Teruya Yamanishi
- AI & IoT Center, Department of Management and Information Sciences, Fukui University of Technology, 3-6-1 Gakuen, Fukui, Fukui, 910-8505, Japan
| |
Collapse
|