1
|
Moyal R, Mama KR, Einhorn M, Borthakur A, Cleland TA. Heterogeneous quantization regularizes spiking neural network activity. Sci Rep 2025; 15:14045. [PMID: 40268966 PMCID: PMC12019593 DOI: 10.1038/s41598-025-96223-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Accepted: 03/24/2025] [Indexed: 04/25/2025] Open
Abstract
The learning and recognition of object features from unregulated input has been a longstanding challenge for artificial intelligence systems. Brains, on the other hand, are adept at learning stable sensory representations given noisy observations, a capacity mediated by a cascade of signal conditioning steps informed by domain knowledge. The olfactory system, in particular, solves a source separation and denoising problem compounded by concentration variability, environmental interference, and unpredictably correlated sensor affinities using a plastic network that requires statistically well-behaved input. We present a data-blind neuromorphic signal conditioning strategy, based on the biological system architecture, that normalizes and quantizes analog data into spike-phase representations, thereby transforming uncontrolled sensory input into a regular form with minimal information loss. Normalized input is delivered to a column of spiking principal neurons via heterogeneous synaptic weights; this gain diversification strategy regularizes neuronal utilization, yoking total activity to the network's operating range and rendering internal representations robust to uncontrolled open-set stimulus variance. To dynamically optimize resource utilization while balancing activity regularization and resolution, we supplement this mechanism with a data-aware calibration strategy in which the range and density of the quantization weights adapt to accumulated input statistics.
Collapse
Affiliation(s)
- Roy Moyal
- Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA.
- AI for Science Institute, Cornell University, Ithaca, NY, 14853, USA.
| | - Kyrus R Mama
- Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA
- Neurosciences Graduate Program, Stanford University, Stanford, CA, 94305, USA
| | - Matthew Einhorn
- Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA
| | - Ayon Borthakur
- Mehta Family School of Data Science and Artificial Intelligence, IIT Guwahati, Guwahati, Assam, 781039, India
| | - Thomas A Cleland
- Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA.
| |
Collapse
|
2
|
Laswick Z, Wu X, Surendran A, Zhou Z, Ji X, Matrone GM, Leong WL, Rivnay J. Tunable anti-ambipolar vertical bilayer organic electrochemical transistor enable neuromorphic retinal pathway. Nat Commun 2024; 15:6309. [PMID: 39060249 PMCID: PMC11282299 DOI: 10.1038/s41467-024-50496-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Accepted: 07/10/2024] [Indexed: 07/28/2024] Open
Abstract
Increasing demand for bio-interfaced human-machine interfaces propels the development of organic neuromorphic electronics with small form factors leveraging both ionic and electronic processes. Ion-based organic electrochemical transistors (OECTs) showing anti-ambipolarity (OFF-ON-OFF states) reduce the complexity and size of bio-realistic Hodgkin-Huxley(HH) spiking circuits and logic circuits. However, limited stable anti-ambipolar organic materials prevent the design of integrated, tunable, and multifunctional neuromorphic and logic-based systems. In this work, a general approach for tuning anti-ambipolar characteristics is presented through assembly of a p-n bilayer in a vertical OECT (vOECT) architecture. The vertical OECT design reduces device footprint, while the bilayer material tuning controls the anti-ambipolarity characteristics, allowing control of the device's on and off threshold voltages, and peak position, while reducing size thereby enabling tunable threshold spiking neurons and logic gates. Combining these components, a mimic of the retinal pathway reproducing the wavelength and light intensity encoding of horizontal cells to spiking retinal ganglion cells is demonstrated. This work enables further incorporation of conformable and adaptive OECT electronics into biointegrated devices featuring sensory coding through parallel processing for diverse artificial intelligence and computing applications.
Collapse
Affiliation(s)
- Zachary Laswick
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| | - Xihu Wu
- School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Abhijith Surendran
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| | - Zhongliang Zhou
- School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Xudong Ji
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| | | | - Wei Lin Leong
- School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore.
| | - Jonathan Rivnay
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA.
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL, 60208, USA.
| |
Collapse
|
3
|
Blanco Malerba S, Micheli A, Woodford M, Azeredo da Silveira R. Jointly efficient encoding and decoding in neural populations. PLoS Comput Biol 2024; 20:e1012240. [PMID: 38985828 PMCID: PMC11262701 DOI: 10.1371/journal.pcbi.1012240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Revised: 07/22/2024] [Accepted: 06/07/2024] [Indexed: 07/12/2024] Open
Abstract
The efficient coding approach proposes that neural systems represent as much sensory information as biological constraints allow. It aims at formalizing encoding as a constrained optimal process. A different approach, that aims at formalizing decoding, proposes that neural systems instantiate a generative model of the sensory world. Here, we put forth a normative framework that characterizes neural systems as jointly optimizing encoding and decoding. It takes the form of a variational autoencoder: sensory stimuli are encoded in the noisy activity of neurons to be interpreted by a flexible decoder; encoding must allow for an accurate stimulus reconstruction from neural activity. Jointly, neural activity is required to represent the statistics of latent features which are mapped by the decoder into distributions over sensory stimuli; decoding correspondingly optimizes the accuracy of the generative model. This framework yields in a family of encoding-decoding models, which result in equally accurate generative models, indexed by a measure of the stimulus-induced deviation of neural activity from the marginal distribution over neural activity. Each member of this family predicts a specific relation between properties of the sensory neurons-such as the arrangement of the tuning curve means (preferred stimuli) and widths (degrees of selectivity) in the population-as a function of the statistics of the sensory world. Our approach thus generalizes the efficient coding approach. Notably, here, the form of the constraint on the optimization derives from the requirement of an accurate generative model, while it is arbitrary in efficient coding models. Moreover, solutions do not require the knowledge of the stimulus distribution, but are learned on the basis of data samples; the constraint further acts as regularizer, allowing the model to generalize beyond the training data. Finally, we characterize the family of models we obtain through alternate measures of performance, such as the error in stimulus reconstruction. We find that a range of models admits comparable performance; in particular, a population of sensory neurons with broad tuning curves as observed experimentally yields both low reconstruction stimulus error and an accurate generative model that generalizes robustly to unseen data.
Collapse
Affiliation(s)
- Simone Blanco Malerba
- Laboratoire de Physique de l’Ecole Normale Supérieure, ENS, Université PSL, CNRS, Sorbonne Université, Université de Paris, Paris, France
- Institute for Neural Information Processing, Center for Molecular Neurobiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Aurora Micheli
- Laboratoire de Physique de l’Ecole Normale Supérieure, ENS, Université PSL, CNRS, Sorbonne Université, Université de Paris, Paris, France
| | - Michael Woodford
- Department of Economics, Columbia University, New York, New York, United States of America
| | - Rava Azeredo da Silveira
- Laboratoire de Physique de l’Ecole Normale Supérieure, ENS, Université PSL, CNRS, Sorbonne Université, Université de Paris, Paris, France
- Institute of Molecular and Clinical Ophthalmology Basel, Basel, Switzerland
- Faculty of Science, University of Basel, Basel, Switzerland
| |
Collapse
|
4
|
Häusler S. Correlations reveal the hierarchical organization of biological networks with latent variables. Commun Biol 2024; 7:678. [PMID: 38831002 PMCID: PMC11148204 DOI: 10.1038/s42003-024-06342-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 05/16/2024] [Indexed: 06/05/2024] Open
Abstract
Deciphering the functional organization of large biological networks is a major challenge for current mathematical methods. A common approach is to decompose networks into largely independent functional modules, but inferring these modules and their organization from network activity is difficult, given the uncertainties and incompleteness of measurements. Typically, some parts of the overall functional organization, such as intermediate processing steps, are latent. We show that the hidden structure can be determined from the statistical moments of observable network components alone, as long as the functional relevance of the network components lies in their mean values and the mean of each latent variable maps onto a scaled expectation of a binary variable. Whether the function of biological networks permits a hierarchical modularization can be falsified by a correlation-based statistical test that we derive. We apply the test to gene regulatory networks, dendrites of pyramidal neurons, and networks of spiking neurons.
Collapse
Affiliation(s)
- Stefan Häusler
- Faculty of Biology and Bernstein Center for Computational Neuroscience, Ludwig-Maximilians-Universität München, Munich, Germany.
| |
Collapse
|
5
|
Vazquez-Guerrero P, Tuladhar R, Psychalinos C, Elwakil A, Chacron MJ, Santamaria F. Fractional order memcapacitive neuromorphic elements reproduce and predict neuronal function. Sci Rep 2024; 14:5817. [PMID: 38461365 PMCID: PMC10925066 DOI: 10.1038/s41598-024-55784-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Accepted: 02/27/2024] [Indexed: 03/11/2024] Open
Abstract
There is an increasing need to implement neuromorphic systems that are both energetically and computationally efficient. There is also great interest in using electric elements with memory, memelements, that can implement complex neuronal functions intrinsically. A feature not widely incorporated in neuromorphic systems is history-dependent action potential time adaptation which is widely seen in real cells. Previous theoretical work shows that power-law history dependent spike time adaptation, seen in several brain areas and species, can be modeled with fractional order differential equations. Here, we show that fractional order spiking neurons can be implemented using super-capacitors. The super-capacitors have fractional order derivative and memcapacitive properties. We implemented two circuits, a leaky integrate and fire and a Hodgkin-Huxley. Both circuits show power-law spiking time adaptation and optimal coding properties. The spiking dynamics reproduced previously published computer simulations. However, the fractional order Hodgkin-Huxley circuit showed novel dynamics consistent with criticality. We compared the responses of this circuit to recordings from neurons in the weakly-electric fish that have previously been shown to perform fractional order differentiation of their sensory input. The criticality seen in the circuit was confirmed in spontaneous recordings in the live fish. Furthermore, the circuit also predicted long-lasting stimulation that was also corroborated experimentally. Our work shows that fractional order memcapacitors provide intrinsic memory dependence that could allow implementation of computationally efficient neuromorphic devices. Memcapacitors are static elements that consume less energy than the most widely studied memristors, thus allowing the realization of energetically efficient neuromorphic devices.
Collapse
Affiliation(s)
- Patricia Vazquez-Guerrero
- Department of Neuroscience, Developmental and Regenerative Biology, The University of Texas at San Antonio, San Antonio, TX, 78349, USA
| | - Rohisha Tuladhar
- Department of Neuroscience, Developmental and Regenerative Biology, The University of Texas at San Antonio, San Antonio, TX, 78349, USA
| | | | - Ahmed Elwakil
- Department of Electrical and Computer Engineering, University of Sharjah, PO Box 27272, Sharjah, UAE
- Department of Electrical and Software Engineering, University of Calgary, Calgary, AB, T2N 1N4, Canada
| | - Maurice J Chacron
- Department of Physiology, McGill University, Quebec, H3G 1Y6, Canada
| | - Fidel Santamaria
- Department of Neuroscience, Developmental and Regenerative Biology, The University of Texas at San Antonio, San Antonio, TX, 78349, USA.
| |
Collapse
|
6
|
Boissonnet T, Tripodi M, Asari H. Awake responses suggest inefficient dense coding in the mouse retina. eLife 2023; 12:e78005. [PMID: 37922200 PMCID: PMC10624425 DOI: 10.7554/elife.78005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Accepted: 09/28/2023] [Indexed: 11/05/2023] Open
Abstract
The structure and function of the vertebrate retina have been extensively studied across species with an isolated, ex vivo preparation. Retinal function in vivo, however, remains elusive, especially in awake animals. Here, we performed single-unit extracellular recordings in the optic tract of head-fixed mice to compare the output of awake, anesthetized, and ex vivo retinas. While the visual response properties were overall similar across conditions, we found that awake retinal output had in general (1) faster kinetics with less variability in the response latencies; (2) a larger dynamic range; and (3) higher firing activity, by ~20 Hz on average, for both baseline and visually evoked responses. Our modeling analyses further showed that such awake response patterns convey comparable total information but less efficiently, and allow for a linear population decoder to perform significantly better than the anesthetized or ex vivo responses. These results highlight distinct retinal behavior in awake states, in particular suggesting that the retina employs dense coding in vivo, rather than sparse efficient coding as has been often assumed from ex vivo studies.
Collapse
Affiliation(s)
- Tom Boissonnet
- Epigenetics and Neurobiology Unit, EMBL Rome, European Molecular Biology LaboratoryMonterotondoItaly
- Collaboration for joint PhD degree between EMBL and Université Grenoble Alpes, Grenoble Institut des NeurosciencesLa TroncheFrance
| | - Matteo Tripodi
- Epigenetics and Neurobiology Unit, EMBL Rome, European Molecular Biology LaboratoryMonterotondoItaly
| | - Hiroki Asari
- Epigenetics and Neurobiology Unit, EMBL Rome, European Molecular Biology LaboratoryMonterotondoItaly
| |
Collapse
|
7
|
Jouandet GC, Alpert MH, Simões JM, Suhendra R, Frank DD, Levy JI, Para A, Kath WL, Gallio M. Rapid threat assessment in the Drosophila thermosensory system. Nat Commun 2023; 14:7067. [PMID: 37923719 PMCID: PMC10624821 DOI: 10.1038/s41467-023-42864-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 10/23/2023] [Indexed: 11/06/2023] Open
Abstract
Neurons that participate in sensory processing often display "ON" responses, i.e., fire transiently at the onset of a stimulus. ON transients are widespread, perhaps universal to sensory coding, yet their function is not always well-understood. Here, we show that ON responses in the Drosophila thermosensory system extrapolate the trajectory of temperature change, priming escape behavior if unsafe thermal conditions are imminent. First, we show that second-order thermosensory projection neurons (TPN-IIIs) and their Lateral Horn targets (TLHONs), display ON responses to thermal stimuli, independent of direction of change (heating or cooling) and of absolute temperature. Instead, they track the rate of temperature change, with TLHONs firing exclusively to rapid changes (>0.2 °C/s). Next, we use connectomics to track TLHONs' output to descending neurons that control walking and escape, and modeling and genetic silencing to demonstrate how ON transients can flexibly amplify aversive responses to small thermal change. Our results suggest that, across sensory systems, ON transients may represent a general mechanism to systematically anticipate and respond to salient or dangerous conditions.
Collapse
Affiliation(s)
| | - Michael H Alpert
- Department of Neurobiology, Northwestern University, Evanston, IL, USA
| | | | - Richard Suhendra
- Department of Engineering Sciences and Applied Mathematics, Northwestern University, Evanston, IL, USA
| | - Dominic D Frank
- Department of Neurobiology, Northwestern University, Evanston, IL, USA
- Laboratory of Social Evolution and Behavior, The Rockefeller University, New York, NY, USA
| | - Joshua I Levy
- Department of Neurobiology, Northwestern University, Evanston, IL, USA
- Department of Immunology and Microbiology, The Scripps Research Institute, La Jolla, CA, USA
| | - Alessia Para
- Department of Neurobiology, Northwestern University, Evanston, IL, USA
| | - William L Kath
- Department of Neurobiology, Northwestern University, Evanston, IL, USA
- Department of Engineering Sciences and Applied Mathematics, Northwestern University, Evanston, IL, USA
- National Institute for Theory and Mathematics in Biology, Northwestern University, Chicago, IL, USA
| | - Marco Gallio
- Department of Neurobiology, Northwestern University, Evanston, IL, USA.
| |
Collapse
|
8
|
Hladnik TC, Grewe J. Receptive field sizes and neuronal encoding bandwidth are constrained by axonal conduction delays. PLoS Comput Biol 2023; 19:e1010871. [PMID: 37566629 PMCID: PMC10446211 DOI: 10.1371/journal.pcbi.1010871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 08/23/2023] [Accepted: 07/20/2023] [Indexed: 08/13/2023] Open
Abstract
Studies on population coding implicitly assume that spikes from the presynaptic cells arrive simultaneously at the integrating neuron. In natural neuronal populations, this is usually not the case-neuronal signaling takes time and populations cover a certain space. The spread of spike arrival times depends on population size, cell density and axonal conduction velocity. Here we analyze the consequences of population size and axonal conduction delays on the stimulus encoding performance in the electrosensory system of the electric fish Apteronotus leptorhynchus. We experimentally locate p-type electroreceptor afferents along the rostro-caudal body axis and relate locations to neurophysiological response properties. In an information-theoretical approach we analyze the coding performance in homogeneous and heterogeneous populations. As expected, the amount of information increases with population size and, on average, heterogeneous populations encode better than the average same-size homogeneous population, if conduction delays are compensated for. The spread of neuronal conduction delays within a receptive field strongly degrades encoding of high-frequency stimulus components. Receptive field sizes typically found in the electrosensory lateral line lobe of A. leptorhynchus appear to be a good compromise between the spread of conduction delays and encoding performance. The limitations imposed by finite axonal conduction velocity are relevant for any converging network as is shown by model populations of LIF neurons. The bandwidth of natural stimuli and the maximum meaningful population sizes are constrained by conduction delays and may thus impact the optimal design of nervous systems.
Collapse
Affiliation(s)
- Tim C. Hladnik
- Institute for Neurobiology, Eberhardt Karls Universität Tübingen, Tübingen, Germany
- Systems Neurobiology, Werner Reichard Center for Integrative Neurobiology, Universität Tübingen, Tübingen, Germany
| | - Jan Grewe
- Institute for Neurobiology, Eberhardt Karls Universität Tübingen, Tübingen, Germany
| |
Collapse
|
9
|
Tichy H, Martzok A, Linhart M, Zopf LM, Hellwig M. Multielectrode recordings of cockroach antennal lobe neurons in response to temporal dynamics of odor concentrations. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2023; 209:411-436. [PMID: 36645471 PMCID: PMC10102049 DOI: 10.1007/s00359-022-01605-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 12/07/2022] [Accepted: 12/17/2022] [Indexed: 01/17/2023]
Abstract
The initial representation of the instantaneous temporal information about food odor concentration in the primary olfactory center, the antennal lobe, was examined by simultaneously recording the activity of antagonistic ON and OFF neurons with 4-channel tetrodes. During presentation of pulse-like concentration changes, ON neurons encode the rapid concentration increase at pulse onset and the pulse duration, and OFF neurons the rapid concentration decrease at pulse offset and the duration of the pulse interval. A group of ON neurons establish a concentration-invariant representation of odor pulses. The responses of ON and OFF neurons to oscillating changes in odor concentration are determined by the rate of change in dependence on the duration of the oscillation period. By adjusting sensitivity for fluctuating concentrations, these neurons improve the representation of the rate of the changing concentration. In other ON and OFF neurons, the response to changing concentrations is invariant to large variations in the rate of change due to variations in the oscillation period, facilitating odor identification in the antennal-lobe. The independent processing of odor identity and the temporal dynamics of odor concentration may speed up processing time and improve behavioral performance associated with plume tracking, especially when the air is not moving.
Collapse
Affiliation(s)
- Harald Tichy
- Department of Neurosciences and Developmental Biology, University of Vienna, Faculty of Life Sciences, Djerassiplatz 1, 1030, Vienna, Austria.
| | - Alexander Martzok
- Department of Neurosciences and Developmental Biology, University of Vienna, Faculty of Life Sciences, Djerassiplatz 1, 1030, Vienna, Austria
| | - Marlene Linhart
- Department of Neurosciences and Developmental Biology, University of Vienna, Faculty of Life Sciences, Djerassiplatz 1, 1030, Vienna, Austria
| | - Lydia M Zopf
- Department of Neurosciences and Developmental Biology, University of Vienna, Faculty of Life Sciences, Djerassiplatz 1, 1030, Vienna, Austria
| | - Maria Hellwig
- Department of Neurosciences and Developmental Biology, University of Vienna, Faculty of Life Sciences, Djerassiplatz 1, 1030, Vienna, Austria
| |
Collapse
|
10
|
Population coding strategies in human tactile afferents. PLoS Comput Biol 2022; 18:e1010763. [DOI: 10.1371/journal.pcbi.1010763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 12/19/2022] [Accepted: 11/28/2022] [Indexed: 12/12/2022] Open
Abstract
Sensory information is conveyed by populations of neurons, and coding strategies cannot always be deduced when considering individual neurons. Moreover, information coding depends on the number of neurons available and on the composition of the population when multiple classes with different response properties are available. Here, we study population coding in human tactile afferents by employing a recently developed simulator of mechanoreceptor firing activity. First, we highlight the interplay of afferents within each class. We demonstrate that the optimal afferent density to convey maximal information depends on both the tactile feature under consideration and the afferent class. Second, we find that information is spread across different classes for all tactile features and that each class encodes both redundant and complementary information with respect to the other afferent classes. Specifically, combining information from multiple afferent classes improves information transmission and is often more efficient than increasing the density of afferents from the same class. Finally, we examine the importance of temporal and spatial contributions, respectively, to the joint spatiotemporal code. On average, destroying temporal information is more destructive than removing spatial information, but the importance of either depends on the stimulus feature analysed. Overall, our results suggest that both optimal afferent innervation densities and the composition of the population depend in complex ways on the tactile features in question, potentially accounting for the variety in which tactile peripheral populations are assembled in different regions across the body.
Collapse
|
11
|
Tesileanu T, Piasini E, Balasubramanian V. Efficient processing of natural scenes in visual cortex. Front Cell Neurosci 2022; 16:1006703. [PMID: 36545653 PMCID: PMC9760692 DOI: 10.3389/fncel.2022.1006703] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 11/17/2022] [Indexed: 12/12/2022] Open
Abstract
Neural circuits in the periphery of the visual, auditory, and olfactory systems are believed to use limited resources efficiently to represent sensory information by adapting to the statistical structure of the natural environment. This "efficient coding" principle has been used to explain many aspects of early visual circuits including the distribution of photoreceptors, the mosaic geometry and center-surround structure of retinal receptive fields, the excess OFF pathways relative to ON pathways, saccade statistics, and the structure of simple cell receptive fields in V1. We know less about the extent to which such adaptations may occur in deeper areas of cortex beyond V1. We thus review recent developments showing that the perception of visual textures, which depends on processing in V2 and beyond in mammals, is adapted in rats and humans to the multi-point statistics of luminance in natural scenes. These results suggest that central circuits in the visual brain are adapted for seeing key aspects of natural scenes. We conclude by discussing how adaptation to natural temporal statistics may aid in learning and representing visual objects, and propose two challenges for the future: (1) explaining the distribution of shape sensitivity in the ventral visual stream from the statistics of object shape in natural images, and (2) explaining cell types of the vertebrate retina in terms of feature detectors that are adapted to the spatio-temporal structures of natural stimuli. We also discuss how new methods based on machine learning may complement the normative, principles-based approach to theoretical neuroscience.
Collapse
Affiliation(s)
- Tiberiu Tesileanu
- Center for Computational Neuroscience, Flatiron Institute, New York, NY, United States
| | - Eugenio Piasini
- Scuola Internazionale Superiore di Studi Avanzati (SISSA), Trieste, Italy
| | - Vijay Balasubramanian
- Department of Physics and Astronomy, David Rittenhouse Laboratory, University of Pennsylvania, Philadelphia, PA, United States
- Santa Fe Institute, Santa Fe, NM, United States
| |
Collapse
|
12
|
Scene statistics and noise determine the relative arrangement of receptive field mosaics. Proc Natl Acad Sci U S A 2021; 118:2105115118. [PMID: 34556573 PMCID: PMC8488585 DOI: 10.1073/pnas.2105115118] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/12/2021] [Indexed: 11/18/2022] Open
Abstract
Across a wide variety of species, cells in the retina specialized for signaling either increases (ON) or decreases (OFF) in light represent one of the most basic building blocks of visual computation. These cells coordinate to form mosaics, with each cell responsible for a small, minimally overlapping portion of visual space, but the ways in which these mosaics could be spatially coordinated with each other are relatively unknown. Here, we show how efficient coding theory, which hypothesizes that the nervous system minimizes the amount of redundant information it encodes, can predict the relative spatial arrangement of ON and OFF mosaics. The most information-efficient arrangements are determined both by levels of noise in the system and the statistics of natural images. Many sensory systems utilize parallel ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways consist of ensembles or grids of ON and OFF detectors spanning sensory space. Yet, encoding by opponent pathways raises a question: How should grids of ON and OFF detectors be arranged to optimally encode natural stimuli? We investigated this question using a model of the retina guided by efficient coding theory. Specifically, we optimized spatial receptive fields and contrast response functions to encode natural images given noise and constrained firing rates. We find that the optimal arrangement of ON and OFF receptive fields exhibits a transition between aligned and antialigned grids. The preferred phase depends on detector noise and the statistical structure of the natural stimuli. These results reveal that noise and stimulus statistics produce qualitative shifts in neural coding strategies and provide theoretical predictions for the configuration of opponent pathways in the nervous system.
Collapse
|
13
|
Mano O, Creamer MS, Badwan BA, Clark DA. Predicting individual neuron responses with anatomically constrained task optimization. Curr Biol 2021; 31:4062-4075.e4. [PMID: 34324832 DOI: 10.1016/j.cub.2021.06.090] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 05/24/2021] [Accepted: 06/29/2021] [Indexed: 01/28/2023]
Abstract
Artificial neural networks trained to solve sensory tasks can develop statistical representations that match those in biological circuits. However, it remains unclear whether they can reproduce properties of individual neurons. Here, we investigated how artificial networks predict individual neuron properties in the visual motion circuits of the fruit fly Drosophila. We trained anatomically constrained networks to predict movement in natural scenes, solving the same inference problem as fly motion detectors. Units in the artificial networks adopted many properties of analogous individual neurons, even though they were not explicitly trained to match these properties. Among these properties was the split into ON and OFF motion detectors, which is not predicted by classical motion detection models. The match between model and neurons was closest when models were trained to be robust to noise. These results demonstrate how anatomical, task, and noise constraints can explain properties of individual neurons in a small neural network.
Collapse
Affiliation(s)
- Omer Mano
- Department of Molecular Cellular and Developmental Biology, Yale University, New Haven, CT 06511, USA; Department of Neuroscience, Yale University, New Haven, CT 06511, USA
| | - Matthew S Creamer
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT 06511, USA
| | - Bara A Badwan
- School of Engineering and Applied Science, Yale University, New Haven, CT 06511, USA
| | - Damon A Clark
- Department of Molecular Cellular and Developmental Biology, Yale University, New Haven, CT 06511, USA; Department of Neuroscience, Yale University, New Haven, CT 06511, USA; Interdepartmental Neuroscience Program, Yale University, New Haven, CT 06511, USA; Department of Physics, Yale University, New Haven, CT 06511, USA.
| |
Collapse
|
14
|
Röth K, Shao S, Gjorgjieva J. Efficient population coding depends on stimulus convergence and source of noise. PLoS Comput Biol 2021; 17:e1008897. [PMID: 33901195 PMCID: PMC8075262 DOI: 10.1371/journal.pcbi.1008897] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2020] [Accepted: 03/19/2021] [Indexed: 11/30/2022] Open
Abstract
Sensory organs transmit information to downstream brain circuits using a neural code comprised of spikes from multiple neurons. According to the prominent efficient coding framework, the properties of sensory populations have evolved to encode maximum information about stimuli given biophysical constraints. How information coding depends on the way sensory signals from multiple channels converge downstream is still unknown, especially in the presence of noise which corrupts the signal at different points along the pathway. Here, we calculated the optimal information transfer of a population of nonlinear neurons under two scenarios. First, a lumped-coding channel where the information from different inputs converges to a single channel, thus reducing the number of neurons. Second, an independent-coding channel when different inputs contribute independent information without convergence. In each case, we investigated information loss when the sensory signal was corrupted by two sources of noise. We determined critical noise levels at which the optimal number of distinct thresholds of individual neurons in the population changes. Comparing our system to classical physical systems, these changes correspond to first- or second-order phase transitions for the lumped- or the independent-coding channel, respectively. We relate our theoretical predictions to coding in a population of auditory nerve fibers recorded experimentally, and find signatures of efficient coding. Our results yield important insights into the diverse coding strategies used by neural populations to optimally integrate sensory stimuli in the presence of distinct sources of noise.
Collapse
Affiliation(s)
- Kai Röth
- Computation in Neural Circuits Group, Max Planck Institute for Brain Research, Frankfurt, Germany
- School of Life Sciences, Technical University of Munich, Freising, Germany
| | - Shuai Shao
- Computation in Neural Circuits Group, Max Planck Institute for Brain Research, Frankfurt, Germany
- Donders Institute and Faculty of Science, Radboud University, Nijmegen, Netherlands
| | - Julijana Gjorgjieva
- Computation in Neural Circuits Group, Max Planck Institute for Brain Research, Frankfurt, Germany
- School of Life Sciences, Technical University of Munich, Freising, Germany
| |
Collapse
|
15
|
Gutierrez GJ, Rieke F, Shea-Brown ET. Nonlinear convergence boosts information coding in circuits with parallel outputs. Proc Natl Acad Sci U S A 2021; 118:e1921882118. [PMID: 33593894 PMCID: PMC7923546 DOI: 10.1073/pnas.1921882118] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Neural circuits are structured with layers of converging and diverging connectivity and selectivity-inducing nonlinearities at neurons and synapses. These components have the potential to hamper an accurate encoding of the circuit inputs. Past computational studies have optimized the nonlinearities of single neurons, or connection weights in networks, to maximize encoded information, but have not grappled with the simultaneous impact of convergent circuit structure and nonlinear response functions for efficient coding. Our approach is to compare model circuits with different combinations of convergence, divergence, and nonlinear neurons to discover how interactions between these components affect coding efficiency. We find that a convergent circuit with divergent parallel pathways can encode more information with nonlinear subunits than with linear subunits, despite the compressive loss induced by the convergence and the nonlinearities when considered separately.
Collapse
Affiliation(s)
- Gabrielle J Gutierrez
- Department of Applied Mathematics, University of Washington, Seattle, WA 98195;
- Department of Physiology and Biophysics, University of Washington, Seattle, WA 98195
| | - Fred Rieke
- Department of Physiology and Biophysics, University of Washington, Seattle, WA 98195
| | - Eric T Shea-Brown
- Department of Applied Mathematics, University of Washington, Seattle, WA 98195
- Department of Physiology and Biophysics, University of Washington, Seattle, WA 98195
| |
Collapse
|
16
|
Kang JH, Jang YJ, Kim T, Lee BC, Lee SH, Im M. Electric Stimulation Elicits Heterogeneous Responses in ON but Not OFF Retinal Ganglion Cells to Transmit Rich Neural Information. IEEE Trans Neural Syst Rehabil Eng 2021; 29:300-309. [PMID: 33395394 DOI: 10.1109/tnsre.2020.3048973] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Retinal implants electrically stimulate surviving retinal neurons to restore vision in people blinded by outer retinal degeneration. Although the healthy retina is known to transmit a vast amount of visual information to the brain, it has not been studied whether prosthetic vision contains a similar amount of information. Here, we assessed the neural information transmitted by population responses arising in brisk transient (BT) and brisk sustained (BS) subtypes of ON and OFF retinal ganglion cells (RGCs) in the rabbit retina. To correlate the response heterogeneity and the information transmission, we first quantified the cell-to-cell heterogeneity by calculating the spike time tiling coefficient (STTC) across spiking patterns of RGCs in each type. Then, we computed the neural information encoded by the RGC population in a given type. In responses to light stimulation, spiking activities were more heterogeneous in OFF than ON RGCs (STTCAVG = 0.36, 0.45, 0.77 and 0.55 for OFF BT, OFF BS, ON BT, and ON BS, respectively). Interestingly, however, in responses to electric stimulation, both BT and BS subtypes of OFF RGCs showed remarkably homogeneous spiking patterns across cells (STTCAVG = 0.93 and 0.82 for BT and BS, respectively), whereas the two subtypes of ON RGCs showed slightly increased populational heterogeneity compared to light-evoked responses (STTCAVG = 0.71 and 0.63 for BT and BS, respectively). Consequently, the neural information encoded by the electrically-evoked responses of a population of 15 RGCs was substantially lower in the OFF than the ON pathway: OFF BT and BS cells transmit only ~23% and ~53% of the neural information transmitted by their ON counterparts. Together with previously-reported natural spiking activities in ON RGCs, the higher neural information may make ON responses more recognizable, eliciting the biased percepts of bright phosphenes.
Collapse
|
17
|
Wendling KP, Ly C. Statistical Analysis of Decoding Performances of Diverse Populations of Neurons. Neural Comput 2021; 33:764-801. [PMID: 33400901 DOI: 10.1162/neco_a_01355] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
A central theme in computational neuroscience is determining the neural correlates of efficient and accurate coding of sensory signals. Diversity, or heterogeneity, of intrinsic neural attributes is known to exist in many brain areas and is thought to significantly affect neural coding. Recent theoretical and experimental work has argued that in uncoupled networks, coding is most accurate at intermediate levels of heterogeneity. Here we consider this question with data from in vivo recordings of neurons in the electrosensory system of weakly electric fish subject to the same realization of noisy stimuli; we use a generalized linear model (GLM) to assess the accuracy of (Bayesian) decoding of stimulus given a population spiking response. The long recordings enable us to consider many uncoupled networks and a relatively wide range of heterogeneity, as well as many instances of the stimuli, thus enabling us to address this question with statistical power. The GLM decoding is performed on a single long time series of data to mimic realistic conditions rather than using trial-averaged data for better model fits. For a variety of fixed network sizes, we generally find that the optimal levels of heterogeneity are at intermediate values, and this holds in all core components of GLM. These results are robust to several measures of decoding performance, including the absolute value of the error, error weighted by the uncertainty of the estimated stimulus, and the correlation between the actual and estimated stimulus. Although a quadratic fit to decoding performance as a function of heterogeneity is statistically significant, the result is highly variable with low R2 values. Taken together, intermediate levels of neural heterogeneity are indeed a prominent attribute for efficient coding even within a single time series, but the performance is highly variable.
Collapse
Affiliation(s)
- Kyle P Wendling
- Department of Statistical Sciences and Operations Research, Virginia Commonwealth University, Richmond, VA 23284, U.S.A.
| | - Cheng Ly
- Department of Statistical Sciences and Operations Research, Virginia Commonwealth University, Richmond, VA 23284, U.S.A.
| |
Collapse
|
18
|
Brackbill N, Rhoades C, Kling A, Shah NP, Sher A, Litke AM, Chichilnisky EJ. Reconstruction of natural images from responses of primate retinal ganglion cells. eLife 2020; 9:e58516. [PMID: 33146609 PMCID: PMC7752138 DOI: 10.7554/elife.58516] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2020] [Accepted: 11/02/2020] [Indexed: 11/23/2022] Open
Abstract
The visual message conveyed by a retinal ganglion cell (RGC) is often summarized by its spatial receptive field, but in principle also depends on the responses of other RGCs and natural image statistics. This possibility was explored by linear reconstruction of natural images from responses of the four numerically-dominant macaque RGC types. Reconstructions were highly consistent across retinas. The optimal reconstruction filter for each RGC - its visual message - reflected natural image statistics, and resembled the receptive field only when nearby, same-type cells were included. ON and OFF cells conveyed largely independent, complementary representations, and parasol and midget cells conveyed distinct features. Correlated activity and nonlinearities had statistically significant but minor effects on reconstruction. Simulated reconstructions, using linear-nonlinear cascade models of RGC light responses that incorporated measured spatial properties and nonlinearities, produced similar results. Spatiotemporal reconstructions exhibited similar spatial properties, suggesting that the results are relevant for natural vision.
Collapse
Affiliation(s)
- Nora Brackbill
- Department of Physics, Stanford UniversityStanfordUnited States
| | - Colleen Rhoades
- Department of Bioengineering, Stanford UniversityStanfordUnited States
| | - Alexandra Kling
- Department of Neurosurgery, Stanford School of MedicineStanfordUnited States
- Department of Ophthalmology, Stanford UniversityStanfordUnited States
- Hansen Experimental Physics Laboratory, Stanford UniversityStanfordUnited States
| | - Nishal P Shah
- Department of Electrical Engineering, Stanford UniversityStanfordUnited States
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa CruzSanta CruzUnited States
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa CruzSanta CruzUnited States
| | - EJ Chichilnisky
- Department of Neurosurgery, Stanford School of MedicineStanfordUnited States
- Department of Ophthalmology, Stanford UniversityStanfordUnited States
- Hansen Experimental Physics Laboratory, Stanford UniversityStanfordUnited States
| |
Collapse
|
19
|
Cone JJ, Bade ML, Masse NY, Page EA, Freedman DJ, Maunsell JHR. Mice Preferentially Use Increases in Cerebral Cortex Spiking to Detect Changes in Visual Stimuli. J Neurosci 2020; 40:7902-7920. [PMID: 32917791 PMCID: PMC7548699 DOI: 10.1523/jneurosci.1124-20.2020] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2020] [Revised: 07/20/2020] [Accepted: 08/26/2020] [Indexed: 01/20/2023] Open
Abstract
Whenever the retinal image changes, some neurons in visual cortex increase their rate of firing whereas others decrease their rate of firing. Linking specific sets of neuronal responses with perception and behavior is essential for understanding mechanisms of neural circuit computation. We trained mice of both sexes to perform visual detection tasks and used optogenetic perturbations to increase or decrease neuronal spiking primary visual cortex (V1). Perceptual reports were always enhanced by increments in V1 spike counts and impaired by decrements, even when increments and decrements in spiking were generated in the same neuronal populations. Moreover, detecting changes in cortical activity depended on spike count integration rather than instantaneous changes in spiking. Recurrent neural networks trained in the task similarly relied on increments in neuronal activity when activity has costs. This work clarifies neuronal decoding strategies used by cerebral cortex to translate cortical spiking into percepts that can be used to guide behavior.SIGNIFICANCE STATEMENT Visual responses in the primary visual cortex (V1) are diverse, in that neurons can be either excited or inhibited by the onset of a visual stimulus. We selectively potentiated or suppressed V1 spiking in mice while they performed contrast change detection tasks. In other experiments, excitation or inhibition was delivered to V1 independent of visual stimuli. Mice readily detected increases in V1 spiking while equivalent reductions in V1 spiking suppressed the probability of detection, even when increases and decreases in V1 spiking were generated in the same neuronal populations. Our data raise the striking possibility that only increments in spiking are used to render information to structures downstream of V1.
Collapse
Affiliation(s)
- Jackson J Cone
- Department of Neurobiology and Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, University of Chicago, Chicago, Illinois 60637
| | - Morgan L Bade
- Department of Neurobiology and Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, University of Chicago, Chicago, Illinois 60637
| | - Nicolas Y Masse
- Department of Neurobiology and Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, University of Chicago, Chicago, Illinois 60637
| | - Elizabeth A Page
- Department of Neurobiology and Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, University of Chicago, Chicago, Illinois 60637
| | - David J Freedman
- Department of Neurobiology and Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, University of Chicago, Chicago, Illinois 60637
| | - John H R Maunsell
- Department of Neurobiology and Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, University of Chicago, Chicago, Illinois 60637
| |
Collapse
|
20
|
Efficient sensory coding of multidimensional stimuli. PLoS Comput Biol 2020; 16:e1008146. [PMID: 32970679 PMCID: PMC7514067 DOI: 10.1371/journal.pcbi.1008146] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2020] [Accepted: 07/12/2020] [Indexed: 11/19/2022] Open
Abstract
According to the efficient coding hypothesis, sensory systems are adapted to maximize their ability to encode information about the environment. Sensory neurons play a key role in encoding by selectively modulating their firing rate for a subset of all possible stimuli. This pattern of modulation is often summarized via a tuning curve. The optimally efficient distribution of tuning curves has been calculated in variety of ways for one-dimensional (1-D) stimuli. However, many sensory neurons encode multiple stimulus dimensions simultaneously. It remains unclear how applicable existing models of 1-D tuning curves are for neurons tuned across multiple dimensions. We describe a mathematical generalization that builds on prior work in 1-D to predict optimally efficient multidimensional tuning curves. Our results have implications for interpreting observed properties of neuronal populations. For example, our results suggest that not all tuning curve attributes (such as gain and bandwidth) are equally useful for evaluating the encoding efficiency of a population. Our brains are tasked with processing a wide range of sensory inputs from the world around us. Natural sensory inputs are often complex and composed of multiple distinctive features (for example, an object may be characterized by its size, shape, color, and weight). Many neurons in the brain play a role in encoding multiple features, or dimensions, of sensory stimuli. Here, we employ the computational technique of population modeling to examine how groups of neurons in the brain can optimally encode multiple dimensions of sensory stimuli. This work provides predictions for theory-driven experiments that can leverage emerging high-throughput neural recording tools to characterize the properties of neuronal populations in response to complex natural stimuli.
Collapse
|
21
|
Hofmann V, Chacron MJ. Neuronal On- and Off-type heterogeneities improve population coding of envelope signals in the presence of stimulus-induced noise. Sci Rep 2020; 10:10194. [PMID: 32576916 PMCID: PMC7311526 DOI: 10.1038/s41598-020-67258-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Accepted: 06/04/2020] [Indexed: 11/14/2022] Open
Abstract
Understanding the mechanisms by which neuronal population activity gives rise to perception and behavior remains a central question in systems neuroscience. Such understanding is complicated by the fact that natural stimuli often have complex structure. Here we investigated how heterogeneities within a sensory neuron population influence the coding of a noisy stimulus waveform (i.e., the noise) and its behaviorally relevant envelope signal (i.e., the signal). We found that On- and Off-type neurons displayed more heterogeneities in their responses to the noise than in their responses to the signal. These differences in heterogeneities had important consequences when quantifying response similarity between pairs of neurons. Indeed, the larger response heterogeneity displayed by On- and Off-type neurons made their pairwise responses to the noise on average more independent than when instead considering pairs of On-type or Off-type neurons. Such relative independence allowed for better averaging out of the noise response when pooling neural activities in a mixed-type (i.e., On- and Off-type) than for same-type (i.e., only On-type or only Off-type), thereby leading to greater information transmission about the signal. Our results thus reveal a function for the combined activities of On- and Off-type neurons towards improving information transmission of envelope stimuli at the population level. Our results will likely generalize because natural stimuli across modalities are characterized by a stimulus waveform whose envelope varies independently as well as because On- and Off-type neurons are observed across systems and species.
Collapse
Affiliation(s)
- Volker Hofmann
- Department of Physiology, McGill University, Montreal, QC, Canada
| | | |
Collapse
|
22
|
Soto F, Hsiang JC, Rajagopal R, Piggott K, Harocopos GJ, Couch SM, Custer P, Morgan JL, Kerschensteiner D. Efficient Coding by Midget and Parasol Ganglion Cells in the Human Retina. Neuron 2020; 107:656-666.e5. [PMID: 32533915 DOI: 10.1016/j.neuron.2020.05.030] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Revised: 04/24/2020] [Accepted: 05/20/2020] [Indexed: 01/03/2023]
Abstract
In humans, midget and parasol ganglion cells account for most of the input from the eyes to the brain. Yet, how they encode visual information is unknown. Here, we perform large-scale multi-electrode array recordings from retinas of treatment-naive patients who underwent enucleation surgery for choroidal malignant melanomas. We identify robust differences in the function of midget and parasol ganglion cells, consistent asymmetries between their ON and OFF types (that signal light increments and decrements, respectively) and divergence in the function of human versus non-human primate retinas. Our computational analyses reveal that the receptive fields of human midget and parasol ganglion cells divide naturalistic movies into adjacent spatiotemporal frequency domains with equal stimulus power, while the asymmetric response functions of their ON and OFF types simultaneously maximize stimulus coverage and information transmission and minimize metabolic cost. Thus, midget and parasol ganglion cells in the human retina efficiently encode our visual environment.
Collapse
Affiliation(s)
- Florentina Soto
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - Jen-Chun Hsiang
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA; Graduate Program in Neuroscience, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - Rithwick Rajagopal
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - Kisha Piggott
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - George J Harocopos
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - Steven M Couch
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - Philip Custer
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - Josh L Morgan
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA
| | - Daniel Kerschensteiner
- John F. Hardesty, MD, Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, Saint Louis, MO 63110, USA; Department of Neuroscience, Washington University School of Medicine, Saint Louis, MO 63110, USA; Department of Biomedical Engineering, Washington University School of Medicine, Saint Louis, MO 63110, USA; Hope Center for Neurological Disorders, Washington University School of Medicine, Saint Louis, MO 63110, USA.
| |
Collapse
|