1
|
Neuromorphic object localization using resistive memories and ultrasonic transducers. Nat Commun 2022; 13:3506. [PMID: 35717413 PMCID: PMC9206646 DOI: 10.1038/s41467-022-31157-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 06/03/2022] [Indexed: 11/25/2022] Open
Abstract
Real-world sensory-processing applications require compact, low-latency, and low-power computing systems. Enabled by their in-memory event-driven computing abilities, hybrid memristive-Complementary Metal-Oxide Semiconductor neuromorphic architectures provide an ideal hardware substrate for such tasks. To demonstrate the full potential of such systems, we propose and experimentally demonstrate an end-to-end sensory processing solution for a real-world object localization application. Drawing inspiration from the barn owl’s neuroanatomy, we developed a bio-inspired, event-driven object localization system that couples state-of-the-art piezoelectric micromachined ultrasound transducer sensors to a neuromorphic resistive memories-based computational map. We present measurement results from the fabricated system comprising resistive memories-based coincidence detectors, delay line circuits, and a full-custom ultrasound sensor. We use these experimental results to calibrate our system-level simulations. These simulations are then used to estimate the angular resolution and energy efficiency of the object localization model. The results reveal the potential of our approach, evaluated in orders of magnitude greater energy efficiency than a microcontroller performing the same task. The real-world object localization application needs a low-latency and power efficient computing system. Here, Moro et al. demonstrate a neuromorphic in-memory event driven system, inspired by the barn owl’s neuroanatomy, which is orders of magnitude more energy efficient than microcontrollers.
Collapse
|
2
|
Christensen-Dalsgaard J, Kuokkanen P, Matthews JE, Carr CE. Strongly directional responses to tones and conspecific calls in the auditory nerve of the Tokay gecko, Gekko gecko. J Neurophysiol 2021; 125:887-902. [PMID: 33534648 DOI: 10.1152/jn.00576.2020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The configuration of lizard ears, where sound can reach both surfaces of the eardrums, produces a strongly directional ear, but the subsequent processing of sound direction by the auditory pathway is unknown. We report here on directional responses from the first stage, the auditory nerve. We used laser vibrometry to measure eardrum responses in Tokay geckos and in the same animals recorded 117 auditory nerve single fiber responses to free-field sound from radially distributed speakers. Responses from all fibers showed strongly lateralized activity at all frequencies, with an ovoidal directivity that resembled the eardrum directivity. Geckos are vocal and showed pronounced nerve fiber directionality to components of the call. To estimate the accuracy with which a gecko could discriminate between sound sources, we computed the Fisher information (FI) for each neuron. FI was highest just contralateral to the midline, front and back. Thus, the auditory nerve could provide a population code for sound source direction, and geckos should have a high capacity to differentiate between midline sound sources. In brain, binaural comparisons, for example, by IE (ipsilateral excitatory, contralateral inhibitory) neurons, should sharpen the lateralized responses and extend the dynamic range of directionality.NEW & NOTEWORTHY In mammals, the two ears are unconnected pressure receivers, and sound direction is computed from binaural interactions in the brain, but in lizards, the eardrums interact acoustically, producing a strongly directional response. We show strongly lateralized responses from gecko auditory nerve fibers to directional sound stimulation and high Fisher information on either side of the midline. Thus, already the auditory nerve provides a population code for sound source direction in the gecko.
Collapse
Affiliation(s)
| | - Paula Kuokkanen
- Department of Biology, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany
| | | | - Catherine E Carr
- Department of Biology, University of Maryland, College Park, Maryland
| |
Collapse
|
3
|
Kettler L, Carr CE. Neural Maps of Interaural Time Difference in the American Alligator: A Stable Feature in Modern Archosaurs. J Neurosci 2019; 39:3882-3896. [PMID: 30886018 PMCID: PMC6520516 DOI: 10.1523/jneurosci.2989-18.2019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2018] [Revised: 02/20/2019] [Accepted: 02/23/2019] [Indexed: 11/21/2022] Open
Abstract
Detection of interaural time differences (ITDs) is crucial for sound localization in most vertebrates. The current view is that optimal computational strategies of ITD detection depend mainly on head size and available frequencies, although evolutionary history should also be taken into consideration. In archosaurs, which include birds and crocodiles, the brainstem nucleus laminaris (NL) developed into the critical structure for ITD detection. In birds, ITDs are mapped in an orderly array or place code, whereas in the mammalian medial superior olive, the analog of NL, maps are not found. As yet, in crocodilians, topographical representations have not been identified. However, nontopographic representations of ITD cannot be excluded due to different anatomical and ethological features of birds and crocodiles. Therefore, we measured ITD-dependent responses in the NL of anesthetized American alligators of either sex and identified the location of the recording sites by lesions made after recording. The measured extracellular field potentials, or neurophonics, were strongly ITD tuned, and their preferred ITDs correlated with the position in NL. As in birds, delay lines, which compensate for external time differences, formed maps of ITD. The broad distributions of best ITDs within narrow frequency bands were not consistent with an optimal coding model. We conclude that the available acoustic cues and the architecture of the acoustic system in early archosaurs led to a stable and similar organization in today's birds and crocodiles, although physical features, such as internally coupled ears, head size, or shape, and audible frequency range, vary among the two groups.SIGNIFICANCE STATEMENT Interaural time difference (ITD) is an important cue for sound localization, and the optimal strategies for encoding ITD in neuronal populations are the subject of ongoing debate. We show that alligators form maps of ITD very similar to birds, suggesting that their common archosaur ancestor reached a stable coding solution different from mammals. Mammals and diapsids evolved tympanic hearing independently, and local optima can be reached in evolution that are not considered by global optimal coding models. Thus, the presence of ITD maps in the brainstem may reflect a local optimum in evolutionary development. Our results underline the importance of comparative animal studies and show that optimal models must be viewed in the light of evolutionary processes.
Collapse
Affiliation(s)
- Lutz Kettler
- Lehrstuhl für Zoologie, Technische Universität München, 85354 Freising, Germany, and
| | - Catherine E Carr
- Department of Biology, University of Maryland, College Park, Maryland 20742
| |
Collapse
|
4
|
Walton PL, Christensen-Dalsgaard J, Carr C. Evolution of Sound Source Localization Circuits in the Nonmammalian Vertebrate Brainstem. BRAIN, BEHAVIOR AND EVOLUTION 2017; 90:131-153. [PMID: 28988244 PMCID: PMC5691234 DOI: 10.1159/000476028] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2016] [Accepted: 04/25/2017] [Indexed: 12/31/2022]
Abstract
The earliest vertebrate ears likely subserved a gravistatic function for orientation in the aquatic environment. However, in addition to detecting acceleration created by the animal's own movements, the otolithic end organs that detect linear acceleration would have responded to particle movement created by external sources. The potential to identify and localize these external sources may have been a major selection force in the evolution of the early vertebrate ear and in the processing of sound in the central nervous system. The intrinsic physiological polarization of sensory hair cells on the otolith organs confers sensitivity to the direction of stimulation, including the direction of particle motion at auditory frequencies. In extant fishes, afferents from otolithic end organs encode the axis of particle motion, which is conveyed to the dorsal regions of first-order octaval nuclei. This directional information is further enhanced by bilateral computations in the medulla and the auditory midbrain. We propose that similar direction-sensitive neurons were present in the early aquatic tetrapods and that selection for sound localization in air acted upon preexisting brain stem circuits like those in fishes. With movement onto land, the early tetrapods may have retained some sensitivity to particle motion, transduced by bone conduction, and later acquired new auditory papillae and tympanic hearing. Tympanic hearing arose in parallel within each of the major tetrapod lineages and would have led to increased sensitivity to a broader frequency range and to modification of the preexisting circuitry for sound source localization.
Collapse
Affiliation(s)
| | | | - Catherine Carr
- Department of Biology, University of Maryland, College Park MD, 20742-4415, USA
| |
Collapse
|
5
|
Tellers P, Lehmann J, Führ H, Wagner H. Envelope contributions to the representation of interaural time difference in the forebrain of barn owls. J Neurophysiol 2017; 118:1871-1887. [PMID: 28679844 DOI: 10.1152/jn.01166.2015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2016] [Revised: 06/29/2017] [Accepted: 06/29/2017] [Indexed: 11/22/2022] Open
Abstract
Birds and mammals use the interaural time difference (ITD) for azimuthal sound localization. While barn owls can use the ITD of the stimulus carrier frequency over nearly their entire hearing range, mammals have to utilize the ITD of the stimulus envelope to extend the upper frequency limit of ITD-based sound localization. ITD is computed and processed in a dedicated neural circuit that consists of two pathways. In the barn owl, ITD representation is more complex in the forebrain than in the midbrain pathway because of the combination of two inputs that represent different ITDs. We speculated that one of the two inputs includes an envelope contribution. To estimate the envelope contribution, we recorded ITD response functions for correlated and anticorrelated noise stimuli in the barn owl's auditory arcopallium. Our findings indicate that barn owls, like mammals, represent both carrier and envelope ITDs of overlapping frequency ranges, supporting the hypothesis that carrier and envelope ITD-based localization are complementary beyond a mere extension of the upper frequency limit.NEW & NOTEWORTHY The results presented in this study show for the first time that the barn owl is able to extract and represent the interaural time difference (ITD) information conveyed by the envelope of a broadband acoustic signal. Like mammals, the barn owl extracts the ITD of the envelope and the carrier of a signal from the same frequency range. These results are of general interest, since they reinforce a trend found in neural signal processing across different species.
Collapse
Affiliation(s)
- Philipp Tellers
- Institute of Biology II, RWTH Aachen University, Aachen, Germany; and
| | - Jessica Lehmann
- Lehrstuhl A für Mathematik, RWTH Aachen University, Aachen, Germany
| | - Hartmut Führ
- Lehrstuhl A für Mathematik, RWTH Aachen University, Aachen, Germany
| | - Hermann Wagner
- Institute of Biology II, RWTH Aachen University, Aachen, Germany; and
| |
Collapse
|
6
|
Schumann F, O'Regan JK. Sensory augmentation: integration of an auditory compass signal into human perception of space. Sci Rep 2017; 7:42197. [PMID: 28195187 PMCID: PMC5307328 DOI: 10.1038/srep42197] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2016] [Accepted: 01/06/2017] [Indexed: 12/30/2022] Open
Abstract
Bio-mimetic approaches to restoring sensory function show great promise in that they rapidly produce perceptual experience, but have the disadvantage of being invasive. In contrast, sensory substitution approaches are non-invasive, but may lead to cognitive rather than perceptual experience. Here we introduce a new non-invasive approach that leads to fast and truly perceptual experience like bio-mimetic techniques. Instead of building on existing circuits at the neural level as done in bio-mimetics, we piggy-back on sensorimotor contingencies at the stimulus level. We convey head orientation to geomagnetic North, a reliable spatial relation not normally sensed by humans, by mimicking sensorimotor contingencies of distal sounds via head-related transfer functions. We demonstrate rapid and long-lasting integration into the perception of self-rotation. Short training with amplified or reduced rotation gain in the magnetic signal can expand or compress the perceived extent of vestibular self-rotation, even with the magnetic signal absent in the test. We argue that it is the reliability of the magnetic signal that allows vestibular spatial recalibration, and the coding scheme mimicking sensorimotor contingencies of distal sounds that permits fast integration. Hence we propose that contingency-mimetic feedback has great potential for creating sensory augmentation devices that achieve fast and genuinely perceptual experiences.
Collapse
Affiliation(s)
- Frank Schumann
- Laboratoire Psychologie de la Perception - CNRS UMR 8242, Université Paris Descartes, Paris, France
| | - J Kevin O'Regan
- Laboratoire Psychologie de la Perception - CNRS UMR 8242, Université Paris Descartes, Paris, France
| |
Collapse
|
7
|
Carr CE, Christensen-Dalsgaard J. Sound Localization Strategies in Three Predators. BRAIN, BEHAVIOR AND EVOLUTION 2015; 86:17-27. [PMID: 26398572 DOI: 10.1159/000435946] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
In this paper, we compare some of the neural strategies for sound localization and encoding interaural time differences (ITDs) in three predatory species of Reptilia, alligators, barn owls and geckos. Birds and crocodilians are sister groups among the extant archosaurs, while geckos are lepidosaurs. Despite the similar organization of their auditory systems, archosaurs and lizards use different strategies for encoding the ITDs that underlie localization of sound in azimuth. Barn owls encode ITD information using a place map, which is composed of neurons serving as labeled lines tuned for preferred spatial locations, while geckos may use a meter strategy or population code composed of broadly sensitive neurons that represent ITD via changes in the firing rate.
Collapse
Affiliation(s)
- Catherine E Carr
- Department of Biology, University of Maryland Center for the Comparative and Evolutionary Biology of Hearing, College Park, Md., USA
| | | |
Collapse
|
8
|
Wylie DR, Gutiérrez-Ibáñez C, Iwaniuk AN. Integrating brain, behavior, and phylogeny to understand the evolution of sensory systems in birds. Front Neurosci 2015; 9:281. [PMID: 26321905 PMCID: PMC4531248 DOI: 10.3389/fnins.2015.00281] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2015] [Accepted: 07/28/2015] [Indexed: 12/29/2022] Open
Abstract
The comparative anatomy of sensory systems has played a major role in developing theories and principles central to evolutionary neuroscience. This includes the central tenet of many comparative studies, the principle of proper mass, which states that the size of a neural structure reflects its processing capacity. The size of structures within the sensory system is not, however, the only salient variable in sensory evolution. Further, the evolution of the brain and behavior are intimately tied to phylogenetic history, requiring studies to integrate neuroanatomy with behavior and phylogeny to gain a more holistic view of brain evolution. Birds have proven to be a useful group for these studies because of widespread interest in their phylogenetic relationships and a wealth of information on the functional organization of most of their sensory pathways. In this review, we examine the principle of proper mass in relation differences in the sensory capabilities among birds. We discuss how neuroanatomy, behavior, and phylogeny can be integrated to understand the evolution of sensory systems in birds providing evidence from visual, auditory, and somatosensory systems. We also consider the concept of a "trade-off," whereby one sensory system (or subpathway within a sensory system), may be expanded in size, at the expense of others, which are reduced in size.
Collapse
Affiliation(s)
- Douglas R. Wylie
- Neurosciences and Mental Health Institute, University of AlbertaEdmonton, AB, Canada
| | | | - Andrew N. Iwaniuk
- Department of Neuroscience, University of LethbridgeLethbridge, AB, Canada
| |
Collapse
|
9
|
Carr CE, Shah S, McColgan T, Ashida G, Kuokkanen PT, Brill S, Kempter R, Wagner H. Maps of interaural delay in the owl's nucleus laminaris. J Neurophysiol 2015. [PMID: 26224776 DOI: 10.1152/jn.00644.2015] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Axons from the nucleus magnocellularis form a presynaptic map of interaural time differences (ITDs) in the nucleus laminaris (NL). These inputs generate a field potential that varies systematically with recording position and can be used to measure the map of ITDs. In the barn owl, the representation of best ITD shifts with mediolateral position in NL, so as to form continuous, smoothly overlapping maps of ITD with iso-ITD contours that are not parallel to the NL border. Frontal space (0°) is, however, represented throughout and thus overrepresented with respect to the periphery. Measurements of presynaptic conduction delay, combined with a model of delay line conduction velocity, reveal that conduction delays can account for the mediolateral shifts in the map of ITD.
Collapse
Affiliation(s)
- Catherine E Carr
- Department of Biology, University of Maryland, College Park, Maryland;
| | - Sahil Shah
- Department of Biology, University of Maryland, College Park, Maryland
| | - Thomas McColgan
- Institute for Biology II, RWTH Aachen, Aachen, Germany; and Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, and Bernstein Center for Computational Neuroscience, Berlin, Germany
| | - Go Ashida
- Department of Biology, University of Maryland, College Park, Maryland
| | - Paula T Kuokkanen
- Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, and Bernstein Center for Computational Neuroscience, Berlin, Germany
| | - Sandra Brill
- Institute for Biology II, RWTH Aachen, Aachen, Germany; and
| | - Richard Kempter
- Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, and Bernstein Center for Computational Neuroscience, Berlin, Germany
| | - Hermann Wagner
- Institute for Biology II, RWTH Aachen, Aachen, Germany; and
| |
Collapse
|
10
|
Porras A, Llinas RR. A bio-inspired multisensory stochastic integration algorithm. Neurocomputing 2015. [DOI: 10.1016/j.neucom.2014.06.080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
11
|
Fischer BJ, Seidl AH. Resolution of interaural time differences in the avian sound localization circuit-a modeling study. Front Comput Neurosci 2014; 8:99. [PMID: 25206329 PMCID: PMC4143899 DOI: 10.3389/fncom.2014.00099] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2014] [Accepted: 08/01/2014] [Indexed: 11/13/2022] Open
Abstract
Interaural time differences (ITDs) are a main cue for sound localization and sound segregation. A dominant model to study ITD detection is the sound localization circuitry in the avian auditory brainstem. Neurons in nucleus laminaris (NL) receive auditory information from both ears via the avian cochlear nucleus magnocellularis (NM) and compare the relative timing of these inputs. Timing of these inputs is crucial, as ITDs in the microsecond range must be discriminated and encoded. We modeled ITD sensitivity of single NL neurons based on previously published data and determined the minimum resolvable ITD for neurons in NL. The minimum resolvable ITD is too large to allow for discrimination by single NL neurons of naturally occurring ITDs for very low frequencies. For high frequency NL neurons (>1 kHz) our calculated ITD resolutions fall well within the natural range of ITDs and approach values of below 10 μs. We show that different parts of the ITD tuning function offer different resolution in ITD coding, suggesting that information derived from both parts may be used for downstream processing. A place code may be used for sound location at frequencies above 500 Hz, but our data suggest the slope of the ITD tuning curve ought to be used for ITD discrimination by single NL neurons at the lowest frequencies. Our results provide an important measure of the necessary temporal window of binaural inputs for future studies on the mechanisms and development of neuronal computation of temporally precise information in this important system. In particular, our data establish the temporal precision needed for conduction time regulation along NM axons.
Collapse
Affiliation(s)
- Brian J Fischer
- Department of Mathematics, Seattle University Seattle, WA, USA
| | - Armin H Seidl
- Virginia Merrill Bloedel Hearing Research Center, Department of Otolaryngology - Head and Neck Surgery, University of Washington Seattle, WA, USA ; Department of Neurology, University of Washington Seattle, WA, USA
| |
Collapse
|
12
|
Abstract
An animal confronts numerous challenges when constructing an optimal navigational route. Spatial representations used for path optimization are likely constrained by critical environmental factors that dictate which neural systems control navigation. Multiple coding schemes depend upon their ecological relevance for a particular species, particularly when dealing with the third, or vertical, dimension of space.
Collapse
|
13
|
Patel M, Reed M. Stimulus encoding within the barn owl optic tectum using gamma oscillations vs. spike rate: a modeling approach. NETWORK (BRISTOL, ENGLAND) 2013; 24:52-74. [PMID: 23406211 DOI: 10.3109/0954898x.2013.763405] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The optic tectum of the barn owl is a multimodal structure with multiple layers, with each layer topographically organized according to spatial receptive field. The response of a site to a stimulus can be measured as either spike rate or local field potential (LFP) gamma (25-90 Hz) power; within superficial layers, spike rate and gamma power spatial tuning curves are narrow and contrast-response functions rise slowly. Within deeper layers, however, spike rate tuning curves broaden and gamma power contrast-response functions sharpen. In this work, we employ a computational model to describe the inputs required to generate these transformations from superficial to deep layers and show that gamma power and spike rate can act as parallel information processing streams.
Collapse
Affiliation(s)
- Mainak Patel
- Department of Mathematics, Duke University, Durham, NC 27708, USA.
| | | |
Collapse
|
14
|
Huo J, Murray A, Wei D. Adaptive visual and auditory map alignment in barn owl superior colliculus and its neuromorphic implementation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2012; 23:1486-1497. [PMID: 24807931 DOI: 10.1109/tnnls.2012.2204771] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Adaptation is one of the most important phenomena in biology. A young barn owl can adapt to imposed environmental changes, such as artificial visual distortion caused by wearing a prism. This adjustment process has been modeled mathematically and the model replicates the sensory map realignment of barn owl superior colliculus (SC) through axonogenesis and synaptogenesis. This allows the biological mechanism to be transferred to an artificial computing system and thereby imbue it with a new form of adaptability to the environment. The model is demonstrated in a real-time robot environment. Results of the experiments are compared with and without prism distortion of vision, and show improved adaptability for the robot. However, the computation speed of the embedded system in the robot is slow. A digital and analog mixed signal very-large-scale integration (VLSI) circuit has been fabricated to implement adaptive sensory pathway changes derived from the SC model at higher speed. VLSI experimental results are consistent with simulation results.
Collapse
|
15
|
Efrati A, Gutfreund Y. Early life exposure to noise alters the representation of auditory localization cues in the auditory space map of the barn owl. J Neurophysiol 2011; 105:2522-35. [PMID: 21368005 DOI: 10.1152/jn.00078.2011] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The auditory space map in the optic tectum (OT) (also known as superior colliculus in mammals) relies on the tuning of neurons to auditory localization cues that correspond to specific sound source locations. This study investigates the effects of early auditory experiences on the neural representation of binaural auditory localization cues. Young barn owls were raised in continuous omnidirectional broadband noise from before hearing onset to the age of ∼ 65 days. Data from these birds were compared with data from age-matched control owls and from normal adult owls (>200 days). In noise-reared owls, the tuning of tectal neurons for interaural level differences and interaural time differences was broader than in control owls. Moreover, in neurons from noise-reared owls, the interaural level differences tuning was biased towards sounds louder in the contralateral ear. A similar bias appeared, but to a much lesser extent, in age-matched control owls and was absent in adult owls. To follow the recovery process from noise exposure, we continued to survey the neural representations in the OT for an extended period of up to several months after removal of the noise. We report that all the noise-rearing effects tended to recover gradually following exposure to a normal acoustic environment. The results suggest that deprivation from experiencing normal acoustic localization cues disrupts the maturation of the auditory space map in the OT.
Collapse
Affiliation(s)
- Adi Efrati
- Department of Physiology and Biophysics, Ruth & Bruce Rappaport Faculty of Medicine, Technion-Israel Institute of Technology, Haifa, 31096, Israel
| | | |
Collapse
|
16
|
Christensen-Dalsgaard J, Tang Y, Carr CE. Binaural processing by the gecko auditory periphery. J Neurophysiol 2011; 105:1992-2004. [PMID: 21325679 DOI: 10.1152/jn.00004.2011] [Citation(s) in RCA: 48] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Lizards have highly directional ears, owing to strong acoustical coupling of the eardrums and almost perfect sound transmission from the contralateral ear. To investigate the neural processing of this remarkable tympanic directionality, we combined biophysical measurements of eardrum motion in the Tokay gecko with neurophysiological recordings from the auditory nerve. Laser vibrometry shows that their ear is a two-input system with approximately unity interaural transmission gain at the peak frequency (∼ 1.6 kHz). Median interaural delays are 260 μs, almost three times larger than predicted from gecko head size, suggesting interaural transmission may be boosted by resonances in the large, open mouth cavity (Vossen et al. 2010). Auditory nerve recordings are sensitive to both interaural time differences (ITD) and interaural level differences (ILD), reflecting the acoustical interactions of direct and indirect sound components at the eardrum. Best ITD and click delays match interaural transmission delays, with a range of 200-500 μs. Inserting a mold in the mouth cavity blocks ITD and ILD sensitivity. Thus the neural response accurately reflects tympanic directionality, and most neurons in the auditory pathway should be directional.
Collapse
|
17
|
Abstract
The ability to determine the location of a sound source is fundamental to hearing. However, auditory space is not represented in any systematic manner on the basilar membrane of the cochlea, the sensory surface of the receptor organ for hearing. Understanding the means by which sensitivity to spatial cues is computed in central neurons can therefore contribute to our understanding of the basic nature of complex neural representations. We review recent evidence concerning the nature of the neural representation of auditory space in the mammalian brain and elaborate on recent advances in the understanding of mammalian subcortical processing of auditory spatial cues that challenge the “textbook” version of sound localization, in particular brain mechanisms contributing to binaural hearing.
Collapse
Affiliation(s)
- Benedikt Grothe
- Division of Neurobiology, Department of Biology II, Ludwig-Maximilians-Universitaet, Munich, Germany; and UCL Ear Institute, University College London, United Kingdom
| | - Michael Pecka
- Division of Neurobiology, Department of Biology II, Ludwig-Maximilians-Universitaet, Munich, Germany; and UCL Ear Institute, University College London, United Kingdom
| | - David McAlpine
- Division of Neurobiology, Department of Biology II, Ludwig-Maximilians-Universitaet, Munich, Germany; and UCL Ear Institute, University College London, United Kingdom
| |
Collapse
|
18
|
Abstract
This Primer focuses on detection of the small interaural time differences that underlie sound localization.
Collapse
Affiliation(s)
- Catherine E Carr
- Department of Biology, University of Maryland, College Park, Maryland, United States of America.
| | | |
Collapse
|
19
|
Target-approaching behavior of barn owls (Tyto alba): influence of sound frequency. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2010; 196:227-40. [DOI: 10.1007/s00359-010-0508-6] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2009] [Revised: 12/17/2009] [Accepted: 01/27/2010] [Indexed: 11/26/2022]
|
20
|
Hausmann L, von Campenhausen M, Endler F, Singheiser M, Wagner H. Improvements of sound localization abilities by the facial ruff of the barn owl (Tyto alba) as demonstrated by virtual ruff removal. PLoS One 2009; 4:e7721. [PMID: 19890389 PMCID: PMC2766829 DOI: 10.1371/journal.pone.0007721] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2009] [Accepted: 10/09/2009] [Indexed: 12/02/2022] Open
Abstract
Background When sound arrives at the eardrum it has already been filtered by the body, head, and outer ear. This process is mathematically described by the head-related transfer functions (HRTFs), which are characteristic for the spatial position of a sound source and for the individual ear. HRTFs in the barn owl (Tyto alba) are also shaped by the facial ruff, a specialization that alters interaural time differences (ITD), interaural intensity differences (ILD), and the frequency spectrum of the incoming sound to improve sound localization. Here we created novel stimuli to simulate the removal of the barn owl's ruff in a virtual acoustic environment, thus creating a situation similar to passive listening in other animals, and used these stimuli in behavioral tests. Methodology/Principal Findings HRTFs were recorded from an owl before and after removal of the ruff feathers. Normal and ruff-removed conditions were created by filtering broadband noise with the HRTFs. Under normal virtual conditions, no differences in azimuthal head-turning behavior between individualized and non-individualized HRTFs were observed. The owls were able to respond differently to stimuli from the back than to stimuli from the front having the same ITD. By contrast, such a discrimination was not possible after the virtual removal of the ruff. Elevational head-turn angles were (slightly) smaller with non-individualized than with individualized HRTFs. The removal of the ruff resulted in a large decrease in elevational head-turning amplitudes. Conclusions/Significance The facial ruff a) improves azimuthal sound localization by increasing the ITD range and b) improves elevational sound localization in the frontal field by introducing a shift of iso–ILD lines out of the midsagittal plane, which causes ILDs to increase with increasing stimulus elevation. The changes at the behavioral level could be related to the changes in the binaural physical parameters that occurred after the virtual removal of the ruff. These data provide new insights into the function of external hearing structures and open up the possibility to apply the results on autonomous agents, creation of virtual auditory environments for humans, or in hearing aids.
Collapse
|
21
|
Abstract
The auditory systems of birds and mammals use timing information from each ear to detect interaural time difference (ITD). To determine whether the Jeffress-type algorithms that underlie sensitivity to ITD in birds are an evolutionarily stable strategy, we recorded from the auditory nuclei of crocodilians, who are the sister group to the birds. In alligators, precisely timed spikes in the first-order nucleus magnocellularis (NM) encode the timing of sounds, and NM neurons project to neurons in the nucleus laminaris (NL) that detect interaural time differences. In vivo recordings from NL neurons show that the arrival time of phase-locked spikes differs between the ipsilateral and contralateral inputs. When this disparity is nullified by their best ITD, the neurons respond maximally. Thus NL neurons act as coincidence detectors. A biologically detailed model of NL with alligator parameters discriminated ITDs up to 1 kHz. The range of best ITDs represented in NL was much larger than in birds, however, and extended from 0 to 1000 micros contralateral, with a median ITD of 450 micros. Thus, crocodilians and birds employ similar algorithms for ITD detection, although crocodilians have larger heads.
Collapse
|
22
|
Pérez ML, Shanbhag SJ, Peña JL. Auditory spatial tuning at the crossroads of the midbrain and forebrain. J Neurophysiol 2009; 102:1472-82. [PMID: 19571193 DOI: 10.1152/jn.00400.2009] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The barn owl's midbrain and forebrain contain neurons tuned to sound direction. The spatial receptive fields of these neurons result from sensitivity to combinations of interaural time (ITD) and level (ILD) differences over a broad frequency range. While a map of auditory space has been described in the midbrain, no similar topographic representation has been found in the forebrain. The first nuclei that belong exclusively to the forebrain and midbrain pathways are the thalamic nucleus ovoidalis (Ov) and the external nucleus of the inferior colliculus (ICx), respectively. The midbrain projects to the auditory thalamus before sharp spatial receptive fields emerge; although Ov and ICx receive projections from the same midbrain nuclei, they are not directly connected. We compared the spatial tuning in Ov and ICx. Thalamic neurons respond to a broader frequency range and their ITD and ILD tuning varied more across frequency. However, neurons in Ov showed spatial receptive fields as selective as neurons in ICx. Thalamic spatial receptive fields were tuned to frontal and contralateral space and correlated with their tuning to ITD and ILD. Our results indicate that spatial tuning emerges in both pathways by similar combination selectivity to ITD and ILD. However, the midbrain and the thalamus do not appear to repeat exactly the same processing, as indicated by the difference in frequency range and the broader tuning to binaural cues. The differences observed at the initial stages of these sound-localization pathways may reflect diverse functions and coding schemes of midbrain and forebrain.
Collapse
Affiliation(s)
- M Lucía Pérez
- Dominick P. Purpura Department of Neuroscience, Albert Einstein College of Medicine, Rose F. Kennedy Center, Rm. 529, 1410 Pelham Pkwy. S., Bronx, NY 10461, USA
| | | | | |
Collapse
|
23
|
Abstract
Although ears capable of detecting airborne sound have arisen repeatedly and independently in different species, most animals that are capable of hearing have a pair of ears. We review the advantages that arise from having two ears and discuss recent research on the similarities and differences in the binaural processing strategies adopted by birds and mammals. We also ask how these different adaptations for binaural and spatial hearing might inform and inspire the development of techniques for future auditory prosthetic devices.
Collapse
|
24
|
Vonderschen K, Wagner H. Tuning to Interaural Time Difference and Frequency Differs Between the Auditory Arcopallium and the External Nucleus of the Inferior Colliculus. J Neurophysiol 2009; 101:2348-61. [DOI: 10.1152/jn.91196.2008] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Barn owls process sound-localization information in two parallel pathways, the midbrain and the forebrain pathway. Exctracellular recordings of neural responses to auditory stimuli from far advanced stations of these pathways, the auditory arcopallium in the forebrain and the external nucleus of the inferior colliculus in the midbrain, demonstrated that the representations of interaural time difference and frequency in the forebrain pathway differ from those in the midbrain pathway. Specifically, low-frequency representation was conserved in the forebrain pathway, while it was lost in the midbrain pathway. Variation of interaural time difference yielded symmetrical tuning curves in the midbrain pathway. By contrast, the typical forebrain-tuning curve was asymmetric with a steep slope crossing zero time difference and a less-steep slope toward larger contralateral time disparities. Low sound frequencies contributed sensitivity to contralateral leading sounds underlying these asymmetries, whereas high frequencies enhanced the steepness of slopes at small interaural time differences. Furthermore, the peaks of time-disparity tuning curves were wider in the forebrain than in the midbrain. The distribution of the steepest slopes of best interaural time differences in the auditory arcopallium, but not in the external nucleus of the inferior colliculus, was centered at zero time difference. The distribution observed in the auditory arocpallium is reminiscent of the situation observed in small mammals. We speculate that the forebrain representation may serve as a population code supporting fine discrimination of central interaural time differences and coarse indication of laterality of a stimulus for large interaural time differences.
Collapse
|
25
|
Huo J, Murray A. The adaptation of visual and auditory integration in the barn owl superior colliculus with Spike Timing Dependent Plasticity. Neural Netw 2008; 22:913-21. [PMID: 19084371 DOI: 10.1016/j.neunet.2008.10.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2008] [Revised: 07/20/2008] [Accepted: 10/29/2008] [Indexed: 11/24/2022]
Abstract
To localize a seen object, the superior colliculus of the barn owl integrates the visual and auditory localization cues which are accessed from the sensory system of the brain. These cues are formed as visual and auditory maps. The alignment between visual and auditory maps is very important for accurate localization in prey behavior. Blindness or prism wearing may interfere this alignment. The juvenile barn owl could adapt its auditory map to this mismatch after several weeks training. Here we investigate this process by building a computational model of auditory and visual integration in deep Superior Colliculus (SC). The adaptation of the map alignment is based on activity dependent axon developing in Inferior Colliculus (IC). This axon growing process is instructed by an inhibitory network in SC while the strength of the inhibition is adjusted by Spike Timing Dependent Plasticity (STDP). The simulation results of this model are in line with the biological experiment and support the idea that STDP is involved in the alignment of sensory maps. This model also provides a new spiking neuron based mechanism capable of eliminating the disparity in visual and auditory map integration.
Collapse
Affiliation(s)
- Juan Huo
- Doctoral Training Center, School of Informatics, The University of Edinburgh, Mayfield Road, Edinburgh, UK.
| | | |
Collapse
|
26
|
Köppl C, Carr CE. Maps of interaural time difference in the chicken's brainstem nucleus laminaris. BIOLOGICAL CYBERNETICS 2008; 98:541-59. [PMID: 18491165 PMCID: PMC3170859 DOI: 10.1007/s00422-008-0220-6] [Citation(s) in RCA: 85] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2007] [Accepted: 01/08/2008] [Indexed: 05/10/2023]
Abstract
Animals, including humans, use interaural time differences (ITDs) that arise from different sound path lengths to the two ears as a cue of horizontal sound source location. The nature of the neural code for ITD is still controversial. Current models differentiate between two population codes: either a map-like rate-place code of ITD along an array of neurons, consistent with a large body of data in the barn owl, or a population rate code, consistent with data from small mammals. Recently, it was proposed that these different codes reflect optimal coding strategies that depend on head size and sound frequency. The chicken makes an excellent test case of this proposal because its physical prerequisites are similar to small mammals, yet it shares a more recent common ancestry with the owl. We show here that, like in the barn owl, the brainstem nucleus laminaris in mature chickens displayed the major features of a place code of ITD. ITD was topographically represented in the maximal responses of neurons along each isofrequency band, covering approximately the contralateral acoustic hemisphere. Furthermore, the represented ITD range appeared to change with frequency, consistent with a pressure gradient receiver mechanism in the avian middle ear. At very low frequencies, below 400 Hz, maximal neural responses were symmetrically distributed around zero ITD and it remained unclear whether there was a topographic representation. These findings do not agree with the above predictions for optimal coding and thus revive the discussion as to what determines the neural coding strategies for ITDs.
Collapse
Affiliation(s)
- Christine Köppl
- Lehrstuhl für Zoologie, Technische Universität München, Lichtenbergstr. 4, 85747, Garching, Germany.
| | | |
Collapse
|
27
|
MacLeod KM, Carr CE. Beyond timing in the auditory brainstem: intensity coding in the avian cochlear nucleus angularis. PROGRESS IN BRAIN RESEARCH 2007; 165:123-33. [PMID: 17925243 DOI: 10.1016/s0079-6123(06)65008-5] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Many of the computational principles for sound localization have emerged from the study of avian brains, especially for the construction of codes for interaural timing differences. Our understanding of the neural codes for interaural level differences, and other intensity-related, non-localization sound processing, has lagged behind. In birds, cochlear nucleus angularis (NA) is an obligatory relay for intensity processing. We present our current knowledge of the cell types found in NA, their responses to auditory stimuli, and their likely coding roles. On a cellular level, our recent experimental and modeling studies have shown that short-term synaptic plasticity in NA is a major player in the division of intensity and timing information into parallel pathways. NA projects to at least four brain stem and midbrain targets, suggesting diverse involvement in a range of different sound processing circuits. Further studies comparing processing in NA and analogous neurons in the mammalian cochlear nucleus will highlight which features are conserved and perhaps may be computationally advantageous, and which are species- or clade-specific details demonstrating either disparate environmental requirements or different solutions to similar problems.
Collapse
Affiliation(s)
- Katrina M MacLeod
- Department of Biology, University of Maryland, College Park, MD 20742, USA.
| | | |
Collapse
|
28
|
Location coding by opponent neural populations in the auditory cortex. PLoS Biol 2005; 3:e78. [PMID: 15736980 PMCID: PMC1044834 DOI: 10.1371/journal.pbio.0030078] [Citation(s) in RCA: 221] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2004] [Accepted: 12/20/2004] [Indexed: 12/04/2022] Open
Abstract
Although the auditory cortex plays a necessary role in sound localization, physiological investigations in the cortex reveal inhomogeneous sampling of auditory space that is difficult to reconcile with localization behavior under the assumption of local spatial coding. Most neurons respond maximally to sounds located far to the left or right side, with few neurons tuned to the frontal midline. Paradoxically, psychophysical studies show optimal spatial acuity across the frontal midline. In this paper, we revisit the problem of inhomogeneous spatial sampling in three fields of cat auditory cortex. In each field, we confirm that neural responses tend to be greatest for lateral positions, but show the greatest modulation for near-midline source locations. Moreover, identification of source locations based on cortical responses shows sharp discrimination of left from right but relatively inaccurate discrimination of locations within each half of space. Motivated by these findings, we explore an opponent-process theory in which sound-source locations are represented by differences in the activity of two broadly tuned channels formed by contra- and ipsilaterally preferring neurons. Finally, we demonstrate a simple model, based on spike-count differences across cortical populations, that provides bias-free, level-invariant localization—and thus also a solution to the “binding problem” of associating spatial information with other nonspatial attributes of sounds. A model relying on properties of auditory cortical neurons recorded in the cat can account for the accurate localization of sounds
Collapse
|