1
|
Newhall K. Distinguishing Noise Sources with Information Theory. PHYSICS 2021. [DOI: 10.1103/physics.14.162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
2
|
Gençağa D, Şengül Ayan S, Farnoudkia H, Okuyucu S. Statistical Approaches for the Analysis of Dependency Among Neurons Under Noise. ENTROPY (BASEL, SWITZERLAND) 2020; 22:E387. [PMID: 33286161 PMCID: PMC7516863 DOI: 10.3390/e22040387] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Revised: 03/09/2020] [Accepted: 03/23/2020] [Indexed: 06/12/2023]
Abstract
Neuronal noise is a major factor affecting the communication between coupled neurons. In this work, we propose a statistical toolset to infer the coupling between two neurons under noise. We estimate these statistical dependencies from data which are generated by a coupled Hodgkin-Huxley (HH) model with additive noise. To infer the coupling using observation data, we employ copulas and information-theoretic quantities, such as the mutual information (MI) and the transfer entropy (TE). Copulas and MI between two variables are symmetric quantities, whereas TE is asymmetric. We demonstrate the performances of copulas and MI as functions of different noise levels and show that they are effective in the identification of the interactions due to coupling and noise. Moreover, we analyze the inference of TE values between neurons as a function of noise and conclude that TE is an effective tool for finding out the direction of coupling between neurons under the effects of noise.
Collapse
Affiliation(s)
- Deniz Gençağa
- Department of Electrical and Electronics Engineering, Antalya Bilim University, 07190 Antalya, Turkey
| | - Sevgi Şengül Ayan
- Department of Industrial Engineering, Antalya Bilim University, 07190 Antalya, Turkey
| | - Hajar Farnoudkia
- Department of Statistics, Middle East Technical University, 06800 Ankara, Turkey
| | - Serdar Okuyucu
- Department of Electrical and Electronics Engineering, Antalya Bilim University, 07190 Antalya, Turkey
| |
Collapse
|
3
|
Roberts TP, Kern FB, Fernando C, Szathmáry E, Husbands P, Philippides AO, Staras K. Encoding Temporal Regularities and Information Copying in Hippocampal Circuits. Sci Rep 2019; 9:19036. [PMID: 31836825 PMCID: PMC6910951 DOI: 10.1038/s41598-019-55395-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Accepted: 11/23/2019] [Indexed: 12/02/2022] Open
Abstract
Discriminating, extracting and encoding temporal regularities is a critical requirement in the brain, relevant to sensory-motor processing and learning. However, the cellular mechanisms responsible remain enigmatic; for example, whether such abilities require specific, elaborately organized neural networks or arise from more fundamental, inherent properties of neurons. Here, using multi-electrode array technology, and focusing on interval learning, we demonstrate that sparse reconstituted rat hippocampal neural circuits are intrinsically capable of encoding and storing sub-second-order time intervals for over an hour timescale, represented in changes in the spatial-temporal architecture of firing relationships among populations of neurons. This learning is accompanied by increases in mutual information and transfer entropy, formal measures related to information storage and flow. Moreover, temporal relationships derived from previously trained circuits can act as templates for copying intervals into untrained networks, suggesting the possibility of circuit-to-circuit information transfer. Our findings illustrate that dynamic encoding and stable copying of temporal relationships are fundamental properties of simple in vitro networks, with general significance for understanding elemental principles of information processing, storage and replication.
Collapse
Affiliation(s)
- Terri P Roberts
- Sussex Neuroscience, University of Sussex, Brighton, BN1 9QG, UK
| | - Felix B Kern
- Sussex Neuroscience, University of Sussex, Brighton, BN1 9QG, UK
- Centre for Computational Neuroscience and Robotics, School of Engineering and Informatics, University of Sussex, Brighton, BN1 9QJ, UK
| | - Chrisantha Fernando
- School of EECS, Queen Mary University of London, E1 4NS, London, UK
- Google DeepMind, London, N1C 4AG, UK
| | - Eörs Szathmáry
- Parmenides Center for the Conceptual Foundations of Science, 82049, Pullach, Munich, Germany
- Institute of Evolution, Centre for Ecological Research, 3 Klebelsberg Kuno Street, 8237, Tihany, Hungary
| | - Phil Husbands
- Sussex Neuroscience, University of Sussex, Brighton, BN1 9QG, UK.
- Centre for Computational Neuroscience and Robotics, School of Engineering and Informatics, University of Sussex, Brighton, BN1 9QJ, UK.
| | - Andrew O Philippides
- Sussex Neuroscience, University of Sussex, Brighton, BN1 9QG, UK
- Centre for Computational Neuroscience and Robotics, School of Engineering and Informatics, University of Sussex, Brighton, BN1 9QJ, UK
| | - Kevin Staras
- Sussex Neuroscience, University of Sussex, Brighton, BN1 9QG, UK.
| |
Collapse
|