Temporal and spatial coding of periodicity information in the inferior colliculus of awake chinchilla (Chinchilla laniger)

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Binaural advantages in sound temporal information processing by neurons in the rat inferior colliculus

Previous studies on the advantages of binaural hearing have long been focused on sound localization and spatial stream segregation. The binaural advantages have also been observed in speech perception in reverberation. Both human speech and animal vocalizations contain temporal features that are critical for speech perception and animal communication. However, whether there are binaural advantages for sound temporal information processing in the central auditory system has not been elucidated. Gap detection threshold (GDT), the ability to detect the shortest silent interval in a sound, has been widely used to measure the auditory temporal resolution. In the present study, we determined GDTs of rat inferior collicular neurons under both monaural and binaural hearing conditions. We found that the majority of the inferior collicular neurons in adult rats exhibited binaural advantages in gap detection, i.e., better neural gap detection ability in binaural hearing conditions compared to monaural hearing condition. However, this binaural advantage in sound temporal information processing was not significant in the inferior collicular neurons of P14-21 and P22-30 rats. Additionally, we also observed age-related changes in neural temporal acuity in the rat inferior colliculus. These results demonstrate a new advantage of binaural hearing (i.e., binaural advantage in temporal processing) in the central auditory system in addition to sound localization and spatial stream segregation.

Depolarization shift in the resting membrane potential of inferior colliculus neurons explains their hyperactivity induced by an acoustic trauma

Introduction

Neuronal hyperactivity has been associated with many brain diseases. In the auditory system, hyperactivity has been linked to hyperacusis and tinnitus. Previous research demonstrated the development of hyperactivity in inferior colliculus (IC) neurons after sound overexposure, but the underlying mechanism of this hyperactivity remains unclear. The main goal of this study was to determine the mechanism of this hyperactivity.

Methods

Experiments were performed on CBA/CaJ mice in a restrained, unanesthetized condition using intracellular recordings with sharp microelectrodes. Recordings were obtained from control (unexposed) and unilaterally sound overexposed groups of mice.

Results

Our data suggest that sound exposure-induced hyperactivity was due to a depolarizing shift of the resting membrane potential (RMP) in the hyperactive neurons. The half width of action potentials in these neurons was also decreased after sound exposure. Surprisingly, we also found an RMP gradient in which neurons have more hyperpolarized RMPs with increasing depth in the IC. This gradient was altered in the overexposed animals.

Gradients of response latencies and temporal precision of auditory neurons extend across the whole inferior colliculus

Neural responses to acoustic stimulation have long been studied throughout the auditory system to understand how sound information is coded for perception. Within the inferior colliculus (IC), a majority of the studies have focused predominantly on characterizing neural responses within the central region (ICC), as it is viewed as part of the lemniscal system mainly responsible for auditory perception. In contrast, the responses of outer cortices (ICO) have largely been unexplored, though they also function in auditory perception tasks. Therefore, we sought to expand on previous work by completing a three-dimensional (3-D) functional mapping study of the whole IC. We analyzed responses to different pure tone and broadband noise stimuli across all IC subregions and correlated those responses with over 2,000 recording locations across the IC. Our study revealed there are well-organized trends for temporal response parameters across the full IC that do not show a clear distinction at the ICC and ICO border. These gradients span from slow, imprecise responses in the caudal-medial IC to fast, precise responses in the rostral-lateral IC, regardless of subregion, including the fastest responses located in the ICO. These trends were consistent at various acoustic stimulation levels. Weaker spatial trends could be found for response duration and spontaneous activity. Apart from tonotopic organization, spatial trends were not apparent for spectral response properties. Overall, these detailed acoustic response maps across the whole IC provide new insights into the organization and function of the IC.NEW & NOTEWORTHY Study of the inferior colliculus (IC) has largely focused on the central nucleus, with little exploration of the outer cortices. Here, we systematically assessed the acoustic response properties from over 2,000 locations in different subregions of the IC. The results revealed spatial trends in temporal response patterns that span all subregions. Furthermore, two populations of temporal response types emerged for neurons in the outer cortices that may contribute to their functional roles in auditory tasks.

The perceptual categorization of multidimensional stimuli is hierarchically organized

As we interact with our surroundings, we encounter the same or similar objects from different perspectives and are compelled to generalize. For example, despite their variety we recognize dog barks as a distinct sound class. While we have some understanding of generalization along a single stimulus dimension (frequency, color), natural stimuli are identifiable by a combination of dimensions. Measuring their interaction is essential to understand perception. Using a 2-dimension discrimination task for mice and frequency or amplitude modulated sounds, we tested untrained generalization across pairs of auditory dimensions in an automatized behavioral paradigm. We uncovered a perceptual hierarchy over the tested dimensions that was dominated by the sound's spectral composition. Stimuli are thus not perceived as a whole, but as a combination of their features, each of which weights differently on the identification of the stimulus according to an established hierarchy, possibly paralleling their differential shaping of neuronal tuning.

Two stages of bandwidth scaling drives efficient neural coding of natural sounds

Theories of efficient coding propose that the auditory system is optimized for the statistical structure of natural sounds, yet the transformations underlying optimal acoustic representations are not well understood. Using a database of natural sounds including human speech and a physiologically-inspired auditory model, we explore the consequences of peripheral (cochlear) and mid-level (auditory midbrain) filter tuning transformations on the representation of natural sound spectra and modulation statistics. Whereas Fourier-based sound decompositions have constant time-frequency resolution at all frequencies, cochlear and auditory midbrain filters bandwidths increase proportional to the filter center frequency. This form of bandwidth scaling produces a systematic decrease in spectral resolution and increase in temporal resolution with increasing frequency. Here we demonstrate that cochlear bandwidth scaling produces a frequency-dependent gain that counteracts the tendency of natural sound power to decrease with frequency, resulting in a whitened output representation. Similarly, bandwidth scaling in mid-level auditory filters further enhances the representation of natural sounds by producing a whitened modulation power spectrum (MPS) with higher modulation entropy than both the cochlear outputs and the conventional Fourier MPS. These findings suggest that the tuning characteristics of the peripheral and mid-level auditory system together produce a whitened output representation in three dimensions (frequency, temporal and spectral modulation) that reduces redundancies and allows for a more efficient use of neural resources. This hierarchical multi-stage tuning strategy is thus likely optimized to extract available information and may underlies perceptual sensitivity to natural sounds.

Frequency response areas of neurons in the mouse inferior colliculus. III. Time-domain responses: Constancy, dynamics, and precision in relation to spectral resolution, and perception in the time domain

The auditory midbrain (central nucleus of inferior colliculus, ICC) receives multiple brainstem projections and recodes auditory information for perception in higher centers. Many neural response characteristics are represented in gradients (maps) in the three-dimensional ICC space. Map overlap suggests that neurons, depending on their ICC location, encode information in several domains simultaneously by different aspects of their responses. Thus, interdependence of coding, e.g. in spectral and temporal domains, seems to be a general ICC principle. Studies on covariation of response properties and possible impact on sound perception are, however, rare. Here, we evaluated tone-evoked single neuron activity from the mouse ICC and compared shapes of excitatory frequency-response areas (including strength and shape of inhibition within and around the excitatory area; classes I, II, III) with types of temporal response patterns and first-spike response latencies. Analyses showed covariation of sharpness of frequency tuning with constancy and precision of responding to tone onsets. Highest precision (first-spike latency jitter < 1 ms) and stable phasic responses throughout frequency-response areas were the quality mainly of class III neurons with broad frequency tuning, least influenced by inhibition. Class II neurons with narrow frequency tuning and dominating inhibitory influence were unsuitable for time domain coding with high precision. The ICC center seems specialized rather for high spectral resolution (class II presence), lateral parts for constantly precise responding to sound onsets (class III presence). Further, the variation of tone-response latencies in the frequency-response areas of individual neurons with phasic, tonic, phasic-tonic, or pauser responses gave rise to the definition of a core area, which represented a time window of about 20 ms from tone onset for tone-onset responding of the whole ICC. This time window corresponds to the roughly 20 ms shortest time interval that was found critical in several auditory perceptual tasks in humans and mice.

Ensemble modeling of auditory streaming reveals potential sources of bistability across the perceptual hierarchy

Perceptual bistability-the spontaneous, irregular fluctuation of perception between two interpretations of a stimulus-occurs when observing a large variety of ambiguous stimulus configurations. This phenomenon has the potential to serve as a tool for, among other things, understanding how function varies across individuals due to the large individual differences that manifest during perceptual bistability. Yet it remains difficult to interpret the functional processes at work, without knowing where bistability arises during perception. In this study we explore the hypothesis that bistability originates from multiple sources distributed across the perceptual hierarchy. We develop a hierarchical model of auditory processing comprised of three distinct levels: a Peripheral, tonotopic analysis, a Central analysis computing features found more centrally in the auditory system, and an Object analysis, where sounds are segmented into different streams. We model bistable perception within this system by applying adaptation, inhibition and noise into one or all of the three levels of the hierarchy. We evaluate a large ensemble of variations of this hierarchical model, where each model has a different configuration of adaptation, inhibition and noise. This approach avoids the assumption that a single configuration must be invoked to explain the data. Each model is evaluated based on its ability to replicate two hallmarks of bistability during auditory streaming: the selectivity of bistability to specific stimulus configurations, and the characteristic log-normal pattern of perceptual switches. Consistent with a distributed origin, a broad range of model parameters across this hierarchy lead to a plausible form of perceptual bistability.

The chinchilla animal model for hearing science and noise-induced hearing loss

The chinchilla animal model for noise-induced hearing loss has an extensive history spanning more than 50 years. Many behavioral, anatomical, and physiological characteristics of the chinchilla make it a valuable animal model for hearing science. These include similarities with human hearing frequency and intensity sensitivity, the ability to be trained behaviorally with acoustic stimuli relevant to human hearing, a docile nature that allows many physiological measures to be made in an awake state, physiological robustness that allows for data to be collected from all levels of the auditory system, and the ability to model various types of conductive and sensorineural hearing losses that mimic pathologies observed in humans. Given these attributes, chinchillas have been used repeatedly to study anatomical, physiological, and behavioral effects of continuous and impulse noise exposures that produce either temporary or permanent threshold shifts. Based on the mechanistic insights from noise-exposure studies, chinchillas have also been used in pre-clinical drug studies for the prevention and rescue of noise-induced hearing loss. This review paper highlights the role of the chinchilla model in hearing science, its important contributions, and its advantages and limitations.

Differential cell-type dependent brain state modulations of sensory representations in the non-lemniscal mouse inferior colliculus

Sensory responses of the neocortex are strongly influenced by brain state changes. However, it remains unclear whether and how the sensory responses of the midbrain are affected. Here we addressed this issue by using in vivo two-photon calcium imaging to monitor the spontaneous and sound-evoked activities in the mouse inferior colliculus (IC). We developed a method enabling us to image the first layer of non-lemniscal IC (IC shell L1) in awake behaving mice. Compared with the awake state, spectral tuning selectivity of excitatory neurons was decreased during isoflurane anesthesia. Calcium imaging in behaving animals revealed that activities of inhibitory neurons were highly correlated with locomotion. Compared with stationary periods, spectral tuning selectivity of excitatory neurons was increased during locomotion. Taken together, our studies reveal that neuronal activities in the IC shell L1 are brain state dependent, whereas the brain state modulates the excitatory and inhibitory neurons differentially.

A hierarchical sparse coding model predicts acoustic feature encoding in both auditory midbrain and cortex

The auditory pathway consists of multiple stages, from the cochlear nucleus to the auditory cortex. Neurons acting at different stages have different functions and exhibit different response properties. It is unclear whether these stages share a common encoding mechanism. We trained an unsupervised deep learning model consisting of alternating sparse coding and max pooling layers on cochleogram-filtered human speech. Evaluation of the response properties revealed that computing units in lower layers exhibited spectro-temporal receptive fields (STRFs) similar to those of inferior colliculus neurons measured in physiological experiments, including properties such as sound onset and termination, checkerboard pattern, and spectral motion. Units in upper layers tended to be tuned to phonetic features such as plosivity and nasality, resembling the results of field recording in human auditory cortex. Variation of the sparseness level of the units in each higher layer revealed a positive correlation between the sparseness level and the strength of phonetic feature encoding. The activities of the units in the top layer, but not other layers, correlated with the dynamics of the first two formants (F1, F2) of all phonemes, indicating the encoding of phoneme dynamics in these units. These results suggest that the principles of sparse coding and max pooling may be universal in the human auditory pathway.

When speech enters the ear, it is subjected to a series of processing stages prior to arriving at the auditory cortex. Neurons acting at different processing stages have different response properties. For example, at the auditory midbrain, a neuron may specifically detect the onsets of a frequency component in the speech, whereas in the auditory cortex, a neuron may specifically detect phonetic features. The encoding mechanisms underlying these neuronal functions remain unclear. To address this issue, we designed a hierarchical sparse coding model, inspired by the sparse activity of neurons in the sensory system, to learn features in speech signals. We found that the computing units in different layers exhibited hierarchical extraction of speech sound features, similar to those of neurons in the auditory midbrain and auditory cortex, although the computational principles in these layers were the same. The results suggest that sparse coding and max pooling represent universal computational principles throughout the auditory pathway.

Temporal Coding of Voice Pitch Contours in Mandarin Tones

Accurate perception of time-variant pitch is important for speech recognition, particularly for tonal languages with different lexical tones such as Mandarin, in which different tones convey different semantic information. Previous studies reported that the auditory nerve and cochlear nucleus can encode different pitches through phase-locked neural activities. However, little is known about how the inferior colliculus (IC) encodes the time-variant periodicity pitch of natural speech. In this study, the Mandarin syllable /ba/ pronounced with four lexical tones (flat, rising, falling then rising and falling) were used as stimuli. Local field potentials (LFPs) and single neuron activity were simultaneously recorded from 90 sites within contralateral IC of six urethane-anesthetized and decerebrate guinea pigs in response to the four stimuli. Analysis of the temporal information of LFPs showed that 93% of the LFPs exhibited robust encoding of periodicity pitch. Pitch strength of LFPs derived from the autocorrelogram was significantly (p < 0.001) stronger for rising tones than flat and falling tones. Pitch strength are also significantly increased (p < 0.05) with the characteristic frequency (CF). On the other hand, only 47% (42 or 90) of single neuron activities were significantly synchronized to the fundamental frequency of the stimulus suggesting that the temporal spiking pattern of single IC neuron could encode the time variant periodicity pitch of speech robustly. The difference between the number of LFPs and single neurons that encode the time-variant F0 voice pitch supports the notion of a transition at the level of IC from direct temporal coding in the spike trains of individual neurons to other form of neural representation.

Midbrain Synchrony to Envelope Structure Supports Behavioral Sensitivity to Single-Formant Vowel-Like Sounds in Noise

Vowels make a strong contribution to speech perception under natural conditions. Vowels are encoded in the auditory nerve primarily through neural synchrony to temporal fine structure and to envelope fluctuations rather than through average discharge rate. Neural synchrony is thought to contribute less to vowel coding in central auditory nuclei, consistent with more limited synchronization to fine structure and the emergence of average-rate coding of envelope fluctuations. However, this hypothesis is largely unexplored, especially in background noise. The present study examined coding mechanisms at the level of the midbrain that support behavioral sensitivity to simple vowel-like sounds using neurophysiological recordings and matched behavioral experiments in the budgerigar. Stimuli were harmonic tone complexes with energy concentrated at one spectral peak, or formant frequency, presented in quiet and in noise. Behavioral thresholds for formant-frequency discrimination decreased with increasing amplitude of stimulus envelope fluctuations, increased in noise, and were similar between budgerigars and humans. Multiunit recordings in awake birds showed that the midbrain encodes vowel-like sounds both through response synchrony to envelope structure and through average rate. Whereas neural discrimination thresholds based on either coding scheme were sufficient to support behavioral thresholds in quiet, only synchrony-based neural thresholds could account for behavioral thresholds in background noise. These results reveal an incomplete transformation to average-rate coding of vowel-like sounds in the midbrain. Model simulations suggest that this transformation emerges due to modulation tuning, which is shared between birds and mammals. Furthermore, the results underscore the behavioral relevance of envelope synchrony in the midbrain for detection of small differences in vowel formant frequency under real-world listening conditions.

Neural and Response Correlations to Complex Natural Sounds in the Auditory Midbrain

How natural communication sounds are spatially represented across the inferior colliculus, the main center of convergence for auditory information in the midbrain, is not known. The neural representation of the acoustic stimuli results from the interplay of locally differing input and the organization of spectral and temporal neural preferences that change gradually across the nucleus. This raises the question of how similar the neural representation of the communication sounds is across these gradients of neural preferences, and whether it also changes gradually. Analyzed neural recordings were multi-unit cluster spike trains from guinea pigs presented with a spectrotemporally rich set of eleven species-specific communication sounds. Using cross-correlation, we analyzed the response similarity of spiking activity across a broad frequency range for neurons of similar and different frequency tuning. Furthermore, we separated the contribution of the stimulus to the correlations to investigate whether similarity is only attributable to the stimulus, or, whether interactions exist between the multi-unit clusters that lead to neural correlations and whether these follow the same representation as the response correlations. We found that similarity of responses is dependent on the neurons' spatial distance for similarly and differently frequency-tuned neurons, and that similarity decreases gradually with spatial distance. Significant neural correlations exist, and contribute to the total response similarity. Our findings suggest that for multi-unit clusters in the mammalian inferior colliculus, the gradual response similarity with spatial distance to natural complex sounds is shaped by neural interactions and the gradual organization of neural preferences.

Synchrony, connectivity, and functional similarity in auditory midbrain local circuits

The central nucleus of the inferior colliculus (ICC) contains a laminar structure that functions as an organizing substrate of ascending inputs and local processing. While topographic distributions of ICC response parameters within and across laminae have been reported, the functional micro-organization of the ICC is less well understood. For pairs of neighboring ICC neurons, we examined the nature of functional connectivity and receptive field preferences to gain a better understanding of the structure and function of local circuits. By recording from pairs of adjacent neurons and presenting pure-tone and dynamic broad-band stimulation, we estimated functional connectivity and local differences in frequency response areas (FRAs), spectrotemporal receptive fields (STRFs), nonlinear input/output functions, and single-spike information. From the cross-covariance functions we identified putative unidirectional as well as bidirectional excitatory/inhibitory interactions. STRFs of neighboring neurons strongly conserve best frequency, and moderately agree in STRF similarity, bandwidth, temporal response type, best modulation frequency, nonlinearity structure, and degree of information processing. Excitatory connectivity was stronger and temporally more precise than for inhibitory connections. Neither connection strength nor degree of synchrony correlated with receptive field parameters. The functional similarity of local pairs of ICC neurons was substantially less than for local pairs in the granular layers of primary auditory cortex (AI). These results imply that while the ICC is an obligatory nexus of ascending information, local neurons are comparatively weakly connected and exhibit considerable receptive field variability, potentially reflecting the heterogeneity of converging inputs to ICC functional zones.

Maps of the Auditory Cortex

One of the fundamental properties of the mammalian brain is that sensory regions of cortex are formed of multiple, functionally specialized cortical field maps (CFMs). Each CFM comprises two orthogonal topographical representations, reflecting two essential aspects of sensory space. In auditory cortex, auditory field maps (AFMs) are defined by the combination of tonotopic gradients, representing the spectral aspects of sound (i.e., tones), with orthogonal periodotopic gradients, representing the temporal aspects of sound (i.e., period or temporal envelope). Converging evidence from cytoarchitectural and neuroimaging measurements underlies the definition of 11 AFMs across core and belt regions of human auditory cortex, with likely homology to those of macaque. On a macrostructural level, AFMs are grouped into cloverleaf clusters, an organizational structure also seen in visual cortex. Future research can now use these AFMs to investigate specific stages of auditory processing, key for understanding behaviors such as speech perception and multimodal sensory integration.

Neural correlates of behavioral amplitude modulation sensitivity in the budgerigar midbrain

Amplitude modulation (AM) is a crucial feature of many communication signals, including speech. Whereas average discharge rates in the auditory midbrain correlate with behavioral AM sensitivity in rabbits, the neural bases of AM sensitivity in species with human-like behavioral acuity are unexplored. Here, we used parallel behavioral and neurophysiological experiments to explore the neural (midbrain) bases of AM perception in an avian speech mimic, the budgerigar (Melopsittacus undulatus). Behavioral AM sensitivity was quantified using operant conditioning procedures. Neural AM sensitivity was studied using chronically implanted microelectrodes in awake, unrestrained birds. Average discharge rates of multiunit recording sites in the budgerigar midbrain were insufficient to explain behavioral sensitivity to modulation frequencies <100 Hz for both tone- and noise-carrier stimuli, even with optimal pooling of information across recording sites. Neural envelope synchrony, in contrast, could explain behavioral performance for both carrier types across the full range of modulation frequencies studied (16-512 Hz). The results suggest that envelope synchrony in the budgerigar midbrain may underlie behavioral sensitivity to AM. Behavioral AM sensitivity based on synchrony in the budgerigar, which contrasts with rate-correlated behavioral performance in rabbits, raises the possibility that envelope synchrony, rather than average discharge rate, might also underlie AM perception in other species with sensitive AM detection abilities, including humans. These results highlight the importance of synchrony coding of envelope structure in the inferior colliculus. Furthermore, they underscore potential benefits of devices (e.g., midbrain implants) that evoke robust neural synchrony.

Periodotopy in the gerbil inferior colliculus: local clustering rather than a gradient map

Periodicities in sound waveforms are widespread, and shape important perceptual attributes of sound including rhythm and pitch. Previous studies have indicated that, in the inferior colliculus (IC), a key processing stage in the auditory midbrain, neurons tuned to different periodicities might be arranged along a periodotopic axis which runs approximately orthogonal to the tonotopic axis. Here we map out the topography of frequency and periodicity tuning in the IC of gerbils in unprecedented detail, using pure tones and different periodic sounds, including click trains, sinusoidally amplitude modulated (SAM) noise and iterated rippled noise. We found that while the tonotopic map exhibited a clear and highly reproducible gradient across all animals, periodotopic maps varied greatly across different types of periodic sound and from animal to animal. Furthermore, periodotopic gradients typically explained only about 10% of the variance in modulation tuning between recording sites. However, there was a strong local clustering of periodicity tuning at a spatial scale of ca. 0.5 mm, which also differed from animal to animal.

Pairing broadband noise with cortical stimulation induces extensive suppression of ascending sensory activity

OBJECTIVE

The corticofugal system can alter coding along the ascending sensory pathway. Within the auditory system, electrical stimulation of the auditory cortex (AC) paired with a pure tone can cause egocentric shifts in the tuning of auditory neurons, making them more sensitive to the pure tone frequency. Since tinnitus has been linked with hyperactivity across auditory neurons, we sought to develop a new neuromodulation approach that could suppress a wide range of neurons rather than enhance specific frequency-tuned neurons.

APPROACH

We performed experiments in the guinea pig to assess the effects of cortical stimulation paired with broadband noise (PN-Stim) on ascending auditory activity within the central nucleus of the inferior colliculus (CNIC), a widely studied region for AC stimulation paradigms.

MAIN RESULTS

All eight stimulated AC subregions induced extensive suppression of activity across the CNIC that was not possible with noise stimulation alone. This suppression built up over time and remained after the PN-Stim paradigm.

SIGNIFICANCE

We propose that the corticofugal system is designed to decrease the brain's input gain to irrelevant stimuli and PN-Stim is able to artificially amplify this effect to suppress neural firing across the auditory system. The PN-Stim concept may have potential for treating tinnitus and other neurological disorders.

Auditory midbrain implant: research and development towards a second clinical trial

The cochlear implant is considered one of the most successful neural prostheses to date, which was made possible by visionaries who continued to develop the cochlear implant through multiple technological and clinical challenges. However, patients without a functional auditory nerve or implantable cochlea cannot benefit from a cochlear implant. The focus of the paper is to review the development and translation of a new type of central auditory prosthesis for this group of patients that is known as the auditory midbrain implant (AMI) and is designed for electrical stimulation within the inferior colliculus. The rationale and results for the first AMI clinical study using a multi-site single-shank array will be presented initially. Although the AMI has achieved encouraging results in terms of safety and improvements in lip-reading capabilities and environmental awareness, it has not yet provided sufficient speech perception. Animal and human data will then be presented to show that a two-shank AMI array can potentially improve hearing performance by targeting specific neurons of the inferior colliculus. A new two-shank array, stimulation strategy, and surgical approach are planned for the AMI that are expected to improve hearing performance in the patients who will be implanted in an upcoming clinical trial funded by the National Institutes of Health. Positive outcomes from this clinical trial will motivate new efforts and developments toward improving central auditory prostheses for those who cannot sufficiently benefit from cochlear implants. This article is part of a Special Issue entitled <Lasker Award>.

The topography of frequency and time representation in primate auditory cortices

Natural sounds can be characterised by their spectral content and temporal modulation, but how the brain is organized to analyse these two critical sound dimensions remains uncertain. Using functional magnetic resonance imaging, we demonstrate a topographical representation of amplitude modulation rate in the auditory cortex of awake macaques. The representation of this temporal dimension is organized in approximately concentric bands of equal rates across the superior temporal plane in both hemispheres, progressing from high rates in the posterior core to low rates in the anterior core and lateral belt cortex. In A1 the resulting gradient of modulation rate runs approximately perpendicular to the axis of the tonotopic gradient, suggesting an orthogonal organisation of spectral and temporal sound dimensions. In auditory belt areas this relationship is more complex. The data suggest a continuous representation of modulation rate across several physiological areas, in contradistinction to a separate representation of frequency within each area.

Sustained selective attention to competing amplitude-modulations in human auditory cortex

Auditory selective attention plays an essential role for identifying sounds of interest in a scene, but the neural underpinnings are still incompletely understood. Recent findings demonstrate that neural activity that is time-locked to a particular amplitude-modulation (AM) is enhanced in the auditory cortex when the modulated stream of sounds is selectively attended to under sensory competition with other streams. However, the target sounds used in the previous studies differed not only in their AM, but also in other sound features, such as carrier frequency or location. Thus, it remains uncertain whether the observed enhancements reflect AM-selective attention. The present study aims at dissociating the effect of AM frequency on response enhancement in auditory cortex by using an ongoing auditory stimulus that contains two competing targets differing exclusively in their AM frequency. Electroencephalography results showed a sustained response enhancement for auditory attention compared to visual attention, but not for AM-selective attention (attended AM frequency vs. ignored AM frequency). In contrast, the response to the ignored AM frequency was enhanced, although a brief trend toward response enhancement occurred during the initial 15 s. Together with the previous findings, these observations indicate that selective enhancement of attended AMs in auditory cortex is adaptive under sustained AM-selective attention. This finding has implications for our understanding of cortical mechanisms for feature-based attentional gain control.

Effects of location and timing of co-activated neurons in the auditory midbrain on cortical activity: implications for a new central auditory prosthesis

OBJECTIVE

An increasing number of deaf individuals are being implanted with central auditory prostheses, but their performance has generally been poorer than for cochlear implant users. The goal of this study is to investigate stimulation strategies for improving hearing performance with a new auditory midbrain implant (AMI). Previous studies have shown that repeated electrical stimulation of a single site in each isofrequency lamina of the central nucleus of the inferior colliculus (ICC) causes strong suppressive effects in elicited responses within the primary auditory cortex (A1). Here we investigate if improved cortical activity can be achieved by co-activating neurons with different timing and locations across an ICC lamina and if this cortical activity varies across A1.

APPROACH

We electrically stimulated two sites at different locations across an isofrequency ICC lamina using varying delays in ketamine-anesthetized guinea pigs. We recorded and analyzed spike activity and local field potentials across different layers and locations of A1.

RESULTS

Co-activating two sites within an isofrequency lamina with short inter-pulse intervals (<5 ms) could elicit cortical activity that is enhanced beyond a linear summation of activity elicited by the individual sites. A significantly greater extent of normalized cortical activity was observed for stimulation of the rostral-lateral region of an ICC lamina compared to the caudal-medial region. We did not identify any location trends across A1, but the most cortical enhancement was observed in supragranular layers, suggesting further integration of the stimuli through the cortical layers.

SIGNIFICANCE

The topographic organization identified by this study provides further evidence for the presence of functional zones across an ICC lamina with locations consistent with those identified by previous studies. Clinically, these results suggest that co-activating different neural populations in the rostral-lateral ICC rather than the caudal-medial ICC using the AMI may improve or elicit different types of hearing capabilities.

Response features across the auditory midbrain reveal an organization consistent with a dual lemniscal pathway

The central auditory system has traditionally been divided into lemniscal and nonlemniscal pathways leading from the midbrain through the thalamus to the cortex. This view has served as an organizing principle for studying, modeling, and understanding the encoding of sound within the brain. However, there is evidence that the lemniscal pathway could be further divided into at least two subpathways, each potentially coding for sound in different ways. We investigated whether such an interpretation is supported by the spatial distribution of response features in the central nucleus of the inferior colliculus (ICC), the part of the auditory midbrain assigned to the lemniscal pathway. We recorded responses to pure tone stimuli in the ICC of ketamine-xylazine-anesthetized guinea pigs and used three-dimensional brain reconstruction techniques to map the location of the recording sites. Compared with neurons in caudal-and-medial regions within an isofrequency lamina of the ICC, neurons in rostral-and-lateral regions responded with shorter first-spike latencies with less spiking jitter, shorter durations of spiking responses, a higher proportion of spikes occurring near the onset of the stimulus, lower thresholds, and larger local field potentials with shorter latencies. Further analysis revealed two distinct clusters of response features located in either the caudal-and-medial or the rostral-and-lateral parts of the isofrequency laminae of the ICC. Thus we report substantial differences in coding properties in two regions of the ICC that are consistent with the hypothesis that the lemniscal pathway is made up of at least two distinct subpathways from the midbrain up to the cortex.

The harmonic organization of auditory cortex

A fundamental structure of sounds encountered in the natural environment is the harmonicity. Harmonicity is an essential component of music found in all cultures. It is also a unique feature of vocal communication sounds such as human speech and animal vocalizations. Harmonics in sounds are produced by a variety of acoustic generators and reflectors in the natural environment, including vocal apparatuses of humans and animal species as well as music instruments of many types. We live in an acoustic world full of harmonicity. Given the widespread existence of the harmonicity in many aspects of the hearing environment, it is natural to expect that it be reflected in the evolution and development of the auditory systems of both humans and animals, in particular the auditory cortex. Recent neuroimaging and neurophysiology experiments have identified regions of non-primary auditory cortex in humans and non-human primates that have selective responses to harmonic pitches. Accumulating evidence has also shown that neurons in many regions of the auditory cortex exhibit characteristic responses to harmonically related frequencies beyond the range of pitch. Together, these findings suggest that a fundamental organizational principle of auditory cortex is based on the harmonicity. Such an organization likely plays an important role in music processing by the brain. It may also form the basis of the preference for particular classes of music and voice sounds.

Sensorineural hearing loss amplifies neural coding of envelope information in the central auditory system of chinchillas

People with sensorineural hearing loss often have substantial difficulty understanding speech under challenging listening conditions. Behavioral studies suggest that reduced sensitivity to the temporal structure of sound may be responsible, but underlying neurophysiological pathologies are incompletely understood. Here, we investigate the effects of noise-induced hearing loss on coding of envelope (ENV) structure in the central auditory system of anesthetized chinchillas. ENV coding was evaluated noninvasively using auditory evoked potentials recorded from the scalp surface in response to sinusoidally amplitude modulated tones with carrier frequencies of 1, 2, 4, and 8 kHz and a modulation frequency of 140 Hz. Stimuli were presented in quiet and in three levels of white background noise. The latency of scalp-recorded ENV responses was consistent with generation in the auditory midbrain. Hearing loss amplified neural coding of ENV at carrier frequencies of 2 kHz and above. This result may reflect enhanced ENV coding from the periphery and/or an increase in the gain of central auditory neurons. In contrast to expectations, hearing loss was not associated with a stronger adverse effect of increasing masker intensity on ENV coding. The exaggerated neural representation of ENV information shown here at the level of the auditory midbrain helps to explain previous findings of enhanced sensitivity to amplitude modulation in people with hearing loss under some conditions. Furthermore, amplified ENV coding may potentially contribute to speech perception problems in people with cochlear hearing loss by acting as a distraction from more salient acoustic cues, particularly in fluctuating backgrounds.

Pitch and plasticity: insights from the pitch matching of chords by musicians with absolute and relative pitch

Absolute pitch (AP) is a form of sound recognition in which musical note names are associated with discrete musical pitch categories. The accuracy of pitch matching by non-AP musicians for chords has recently been shown to depend on stimulus familiarity, pointing to a role of spectral recognition mechanisms in the early stages of pitch processing. Here we show that pitch matching accuracy by AP musicians was also dependent on their familiarity with the chord stimulus. This suggests that the pitch matching abilities of both AP and non-AP musicians for concurrently presented pitches are dependent on initial recognition of the chord. The dual mechanism model of pitch perception previously proposed by the authors suggests that spectral processing associated with sound recognition primes waveform processing to extract stimulus periodicity and refine pitch perception. The findings presented in this paper are consistent with the dual mechanism model of pitch, and in the case of AP musicians, the formation of nominal pitch categories based on both spectral and periodicity information.

Neural representation in the auditory midbrain of the envelope of vocalizations based on a peripheral ear model

The auditory midbrain implant (AMI) consists of a single shank array (20 sites) for stimulation along the tonotopic axis of the central nucleus of the inferior colliculus (ICC) and has been safely implanted in deaf patients who cannot benefit from a cochlear implant (CI). The AMI improves lip-reading abilities and environmental awareness in the implanted patients. However, the AMI cannot achieve the high levels of speech perception possible with the CI. It appears the AMI can transmit sufficient spectral cues but with limited temporal cues required for speech understanding. Currently, the AMI uses a CI-based strategy, which was originally designed to stimulate each frequency region along the cochlea with amplitude-modulated pulse trains matching the envelope of the bandpass-filtered sound components. However, it is unclear if this type of stimulation with only a single site within each frequency lamina of the ICC can elicit sufficient temporal cues for speech perception. At least speech understanding in quiet is still possible with envelope cues as low as 50 Hz. Therefore, we investigated how ICC neurons follow the bandpass-filtered envelope structure of natural stimuli in ketamine-anesthetized guinea pigs. We identified a subset of ICC neurons that could closely follow the envelope structure (up to ß100 Hz) of a diverse set of species-specific calls, which was revealed by using a peripheral ear model to estimate the true bandpass-filtered envelopes observed by the brain. Although previous studies have suggested a complex neural transformation from the auditory nerve to the ICC, our data suggest that the brain maintains a robust temporal code in a subset of ICC neurons matching the envelope structure of natural stimuli. Clinically, these findings suggest that a CI-based strategy may still be effective for the AMI if the appropriate neurons are entrained to the envelope of the acoustic stimulus and can transmit sufficient temporal cues to higher centers.

Increasing diversity of neural responses to speech sounds across the central auditory pathway

Neurons at higher stations of each sensory system are responsive to feature combinations not present at lower levels. As a result, the activity of these neurons becomes less redundant than lower levels. We recorded responses to speech sounds from the inferior colliculus and the primary auditory cortex neurons of rats, and tested the hypothesis that primary auditory cortex neurons are more sensitive to combinations of multiple acoustic parameters compared to inferior colliculus neurons. We independently eliminated periodicity information, spectral information and temporal information in each consonant and vowel sound using a noise vocoder. This technique made it possible to test several key hypotheses about speech sound processing. Our results demonstrate that inferior colliculus responses are spatially arranged and primarily determined by the spectral energy and the fundamental frequency of speech, whereas primary auditory cortex neurons generate widely distributed responses to multiple acoustic parameters, and are not strongly influenced by the fundamental frequency of speech. We found no evidence that inferior colliculus or primary auditory cortex was specialized for speech features such as voice onset time or formants. The greater diversity of responses in primary auditory cortex compared to inferior colliculus may help explain how the auditory system can identify a wide range of speech sounds across a wide range of conditions without relying on any single acoustic cue.

Neurometric amplitude-modulation detection threshold in the guinea-pig ventral cochlear nucleus

Amplitude modulation (AM) is a pervasive feature of natural sounds. Neural detection and processing of modulation cues is behaviourally important across species. Although most ecologically relevant sounds are not fully modulated, physiological studies have usually concentrated on fully modulated (100% modulation depth) signals. Psychoacoustic experiments mainly operate at low modulation depths, around detection threshold (∼5% AM). We presented sinusoidal amplitude-modulated tones, systematically varying modulation depth between zero and 100%, at a range of modulation frequencies, to anaesthetised guinea-pigs while recording spikes from neurons in the ventral cochlear nucleus (VCN). The cochlear nucleus is the site of the first synapse in the central auditory system. At this locus significant signal processing occurs with respect to representation of AM signals. Spike trains were analysed in terms of the vector strength of spike synchrony to the amplitude envelope. Neurons showed either low-pass or band-pass temporal modulation transfer functions, with the proportion of band-pass responses increasing with increasing sound level. The proportion of units showing a band-pass response varies with unit type: sustained chopper (CS) > transient chopper (CT) > primary-like (PL). Spike synchrony increased with increasing modulation depth. At the lowest modulation depth (6%), significant spike synchrony was only observed near to the unit's best modulation frequency for all unit types tested. Modulation tuning therefore became sharper with decreasing modulation depth. AM detection threshold was calculated for each individual unit as a function of modulation frequency. Chopper units have significantly better AM detection thresholds than do primary-like units. AM detection threshold is significantly worse at 40 dB vs. 10 dB above pure-tone spike rate threshold. Mean modulation detection thresholds for sounds 10 dB above pure-tone spike rate threshold at best modulation frequency are (95% CI) 11.6% (10.0-13.1) for PL units, 9.8% (8.2-11.5) for CT units, and 10.8% (8.4-13.2) for CS units. The most sensitive guinea-pig VCN single unit AM detection thresholds are similar to human psychophysical performance (∼3% AM), while the mean neurometric thresholds approach whole animal behavioural performance (∼10% AM).

Tonotopic and localized pathways from primary auditory cortex to the central nucleus of the inferior colliculus

Descending projections from the cortex to subcortical structures are critical for auditory plasticity, including the ability for central neurons to adjust their frequency tuning to relevant and meaningful stimuli. We show that focal electrical stimulation of primary auditory cortex in guinea pigs produces excitatory responses in the central nucleus of the inferior colliculus (CNIC) with two tonotopic patterns: a narrow tuned pattern that is consistent with previous findings showing direct frequency-aligned projections; and a broad tuned pattern in which the auditory cortex can influence multiple frequency regions. Moreover, excitatory responses could be elicited in the caudomedial portion along the isofrequency laminae of the CNIC but not in the rostrolateral portion. This descending organization may underlie or contribute to the ability of the auditory cortex to induce changes in frequency tuning of subcortical neurons as shown extensively in previous studies.

Functional architecture of the inferior colliculus revealed with voltage-sensitive dyes

We used optical imaging with voltage-sensitive dyes to investigate the spatio-temporal dynamics of synaptically evoked activity in brain slices of the inferior colliculus (IC). Responses in transverse slices which preserve cross-frequency connections and in modified sagittal slices that preserve connections within frequency laminae were evoked by activating the lateral lemniscal tract. Comparing activity between small and large populations of cells revealed response areas in the central nucleus of the IC that were similar in magnitude but graded temporally. In transverse sections, these response areas are summed to generate a topographic response profile. Activity through the commissure to the contralateral IC required an excitation threshold that was reached when GABAergic inhibition was blocked. Within laminae, module interaction created temporal homeostasis. Diffuse activity evoked by a single lemniscal shock re-organized into distinct spatial and temporal compartments when stimulus trains were used, and generated a directional activity profile within the lamina. Using different stimulus patterns to activate subsets of microcircuits in the central nucleus of the IC, we found that localized responses evoked by low-frequency stimulus trains spread extensively when train frequency was increased, suggesting recruitment of silent microcircuits. Long stimulus trains activated a circuit specific to post-inhibitory rebound neurons. Rebound microcircuits were defined by a focal point of initiation that spread to an annular ring that oscillated between inhibition and excitation. We propose that much of the computing power of the IC is derived from local circuits, some of which are cell-type specific. These circuits organize activity within and across frequency laminae, and are critical in determining the stimulus-selectivity of auditory coding.

Spectrotemporal sound preferences of neighboring inferior colliculus neurons: implications for local circuitry and processing

How do local circuits in the inferior colliculus (IC) process and transform spectral and temporal sound information? Using a four-tetrode array we examined the functional properties of the IC and metrics of its micro circuitry by recording neural activity from neighboring single neurons in the cat. Spectral and temporal response preferences were compared for neurons found on the same and adjacent tetrodes (ATs), as well as across distant recording sites. We found that neighboring neurons had similar preferences while neurons recorded across distant sites were less similar. Best frequency (BF) was the most correlated parameter between neighboring neurons and BF differences exhibited unique clustering at ~0.3 octave intervals, indicative of the frequency band lamina. Other spectral and temporal parameters of the receptive fields were more similar for neighboring neurons than for those at distant sites and the receptive field similarity was larger for neurons with small differences in BF. Furthermore, correlated firing was stronger for neighboring neuron pairs and increased with proximity and decreasing BF difference. Thus, although response selectivities are quite diverse in the IC, spectral, and temporal preference within a local microcircuit are functionally quite similar. This suggests a scheme where local circuits are organized into zones that are specialized for processing distinct spectrotemporal cues.

Coactivation of different neurons within an isofrequency lamina of the inferior colliculus elicits enhanced auditory cortical activation

The phenomenal success of the cochlear implant (CI) is attributed to its ability to provide sufficient temporal and spectral cues for speech understanding. Unfortunately, the CI is ineffective for those without a functional auditory nerve or an implantable cochlea required for CI implementation. As an alternative, our group developed and implanted in deaf patients a new auditory midbrain implant (AMI) to stimulate the central nucleus of the inferior colliculus (ICC). Although the AMI can provide frequency cues, it appears to insufficiently transmit temporal cues for speech understanding. The three-dimensional ICC consists of two-dimensional isofrequency laminae. The single-shank AMI only stimulates one site in any given ICC lamina and does not exhibit enhanced activity (i.e., louder percepts or lower thresholds) for repeated pulses on the same site with intervals <2-5 ms, as occurs for CI pulse or acoustic click stimulation. This enhanced activation, related to short-term temporal integration, is important for tracking the rapid temporal fluctuations of a speech signal. Therefore, we investigated the effects of coactivation of different regions within an ICC lamina on primary auditory cortex activity in ketamine-anesthetized guinea pigs. Interestingly, our findings reveal an enhancement mechanism for integrating converging inputs from an ICC lamina on a fast scale (<6-ms window) that is compromised when stimulating just a single ICC location. Coactivation of two ICC regions also reduces the strong and long-term (>100 ms) suppressive effects induced by repeated stimulation of just a single location. Improving AMI performance may require at least two shanks implanted along the tonotopic gradient of the ICC that enables coactivation of multiple regions along an ICC lamina with the appropriate interstimulus delays.

A neurocognitive model of recognition and pitch segregation

This paper describes a neurocognitive model of pitch segregation in which it is proposed that recognition mechanisms initiate early in auditory processing pathways so that long-term memory templates may be employed to segregate and integrate auditory features. In this model neural representations of pitch height are primed by the location and pattern of excitation across auditory filter channels in relation to long-term memory templates for common stimuli. Since waveform driven pitch mechanisms may produce information at multiple frequencies for tonal stimuli, pitch priming was assumed to include competitive inhibition that would allow only one pitch estimation at any time. Consequently concurrent pitch information must be relayed to short-term memory via a parallel mechanism that employs pitch information contained in the long-term memory template of the chord. Pure tones, harmonic complexes and two pitch chords of harmonic complexes were correctly classified by the correlation of templates comprising auditory nerve excitation and off-frequency inhibition with the excitation patterns of stimuli. The model then replicated behavioral data for pitch matching of concurrent vowels. Comparison of model outputs to the behavioral data suggests that inability to recognize a stimulus was associated with poor pitch segregation due to the use of inappropriate pitch priming strategies.

Orthogonal representation of sound dimensions in the primate midbrain

Natural sounds are characterized by their spectral content and the modulation of energy over time. Using functional magnetic resonance imaging in awake macaques, we observed topographical representations of these spectral and temporal dimensions in a single structure, the inferior colliculus, the principal auditory nucleus in the midbrain. These representations are organized as a map with two approximately perpendicular axes: one representing increasing temporal rate and the other increasing spectral frequency.

Estimated Cochlear Delays in Low Best-Frequency Neurons in the Barn Owl Cannot Explain Coding of Interaural Time Difference

The functional role of the low-frequency range (<3 kHz) in barn owl hearing is not well understood. Here, it was tested whether cochlear delays could explain the representation of interaural time difference (ITD) in this frequency range. Recordings were obtained from neurons in the core of the central nucleus of the inferior colliculus. The response of these neurons varied with the ITD of the stimulus. The response peak shared by all neurons in a dorsoventral penetration was called the array-specific ITD and served as criterion for the representation of a given ITD in a neuron. Array-specific ITDs were widely distributed. Isolevel frequency response functions obtained with binaural, contralateral, and ispilateral stimulation exhibited a clear response peak and the accompanying frequency was called the best frequency. The data were tested with respect to predictions of a model, the stereausis model, assuming cochlear delays as source for the best ITD of a neuron. According to this model, different cochlear delays determined by mismatches between the ipsilateral and contralateral best frequencies are the source for the ITD in a binaural neuron. The mismatch should depend on the best frequency and the best ITD. The predictions of the stereausis model were not fulfilled in the low best-frequency neurons analyzed here. It is concluded that cochlear delays are not responsible for the representation of best ITD in the barn owl.

Perception of the missing fundamental by chinchillas in the presence of low-pass masking noise

The pitch of the missing fundamental (F0) is one of the principal psychological attributes of human pitch perception. Behavioral responses to harmonic tone complexes having missing F0s were measured in chinchillas using operant conditioning and stimulus generalization. Animals were trained to discriminate between tone complexes having a 500-Hz F0 and a 125-Hz F0. When animals were tested with tone complexes having the same F0s, but where the F0s were missing, responses were similar to those obtained when the F0s were present, suggesting that missing F0 sounds were perceptually equivalent to F0 present sounds. Behavioral responses to F0 present and missing F0 stimuli were similar in the presence of low-pass masking noise, suggesting that the perception was not due to the reinsertion of the F0 through cochlear nonlinearities. Gradients in behavioral responses were observed when the F0s of test complexes were systematically varied, suggesting the existence of a psychological dimension related to F0. Behavioral responses were related to the F0 rather than to spectral differences among test stimuli when the F0 and spectrum were varied independently. The results indicate that chinchillas possess a pitch-like perception of the missing F0 that is unlikely to arise from cochlear distortion products.

Effects of pulse phase duration and location of stimulation within the inferior colliculus on auditory cortical evoked potentials in a guinea pig model

The auditory midbrain implant (AMI), which consists of a single shank array designed for stimulation within the central nucleus of the inferior colliculus (ICC), has been developed for deaf patients who cannot benefit from a cochlear implant. Currently, performance levels in clinical trials for the AMI are far from those achieved by the cochlear implant and vary dramatically across patients, in part due to stimulation location effects. As an initial step towards improving the AMI, we investigated how stimulation of different regions along the isofrequency domain of the ICC as well as varying pulse phase durations and levels affected auditory cortical activity in anesthetized guinea pigs. This study was motivated by the need to determine in which region to implant the single shank array within a three-dimensional ICC structure and what stimulus parameters to use in patients. Our findings indicate that complex and unfavorable cortical activation properties are elicited by stimulation of caudal-dorsal ICC regions with the AMI array. Our results also confirm the existence of different functional regions along the isofrequency domain of the ICC (i.e., a caudal-dorsal and a rostral-ventral region), which has been traditionally unclassified. Based on our study as well as previous animal and human AMI findings, we may need to deliver more complex stimuli than currently used in the AMI patients to effectively activate the caudal ICC or ensure that the single shank AMI is only implanted into a rostral-ventral ICC region in future patients.

Cortical encoding of pitch: recent results and open questions

It is widely appreciated that the key predictor of the pitch of a sound is its periodicity. Neural structures which support pitch perception must therefore be able to reflect the repetition rate of a sound, but this alone is not sufficient. Since pitch is a psychoacoustic property, a putative cortical code for pitch must also be able to account for the relationship between the amount to which a sound is periodic (i.e. its temporal regularity) and the perceived pitch salience, as well as limits in our ability to detect pitch changes or to discriminate rising from falling pitch. Pitch codes must also be robust in the presence of nuisance variables such as loudness or timbre. Here, we review a large body of work on the cortical basis of pitch perception, which illustrates that the distribution of cortical processes that give rise to pitch perception is likely to depend on both the acoustical features and functional relevance of a sound. While previous studies have greatly advanced our understanding, we highlight several open questions regarding the neural basis of pitch perception. These questions can begin to be addressed through a cooperation of investigative efforts across species and experimental techniques, and, critically, by examining the responses of single neurons in behaving animals.

Parameters for a model of an oscillating neuronal network in the cochlear nucleus defined by genetic algorithms

Chopper neurons in the cochlear nucleus are characterized by intrinsic oscillations with short average interspike intervals (ISIs) and relative level independence of their response (Pfeiffer, Exp Brain Res 1:220-235, 1966; Blackburn and Sachs, J Neurophysiol 62:1303-1329, 1989), properties which are unattained by models of single chopper neurons (e.g., Rothman and Manis, J Neurophysiol 89:3070-3082, 2003a). In order to achieve short ISIs, we optimized the time constants of Rothman and Manis single neuron model with genetic algorithms. Some parameters in the optimization, such as the temperature and the capacity of the cell, turned out to be crucial for the required acceleration of their response. In order to achieve the relative level independence, we have simulated an interconnected network consisting of Rothman and Manis neurons. The results indicate that by stabilization of intrinsic oscillations, it is possible to simulate the physiologically observed level independence of ISIs. As previously reviewed and demonstrated (Bahmer and Langner, Biol Cybern 95:371-379, 2006a), chopper neurons show a preference for ISIs which are multiples of 0.4 ms. It was also demonstrated that the network consisting of two optimized Rothman and Manis neurons which activate each other with synaptic delays of 0.4 ms shows a preference for ISIs of 0.8 ms. Oscillations with various multiples of 0.4 ms as ISIs may be derived from neurons in a more complex network that is activated by simultaneous input of an onset neuron and several auditory nerve fibers.

Spectral and temporal modulation tradeoff in the inferior colliculus

The cochlea encodes sounds through frequency-selective channels that exhibit low-pass modulation sensitivity. Unlike the cochlea, neurons in the auditory midbrain are tuned for spectral and temporal modulations found in natural sounds, yet the role of this transformation is not known. We report a distinct tradeoff in modulation sensitivity and tuning that is topographically ordered within the central nucleus of the inferior colliculus (CNIC). Spectrotemporal receptive fields (STRFs) were obtained with 16-channel electrodes inserted orthogonal to the isofrequency lamina. Surprisingly, temporal and spectral characteristics exhibited an opposing relationship along the tonotopic axis. For low best frequencies (BFs), units were selective for fast temporal and broad spectral modulations. A systematic progression was observed toward slower temporal and finer spectral modulation sensitivity at high BF. This tradeoff was strongly reflected in the arrangement of excitation and inhibition and, consequently, in the modulation tuning characteristics. Comparisons with auditory nerve fibers show that these trends oppose the pattern imposed by the peripheral filters. These results suggest that spectrotemporal preferences are reordered within the tonotopic axis of the CNIC. This topographic organization has profound implications for the coding of spectrotemporal features in natural sounds and could underlie a number of perceptual phenomena.

A map of periodicity orthogonal to frequency representation in the cat auditory cortex

Harmonic sounds, such as voiced speech sounds and many animal communication signals, are characterized by a pitch related to the periodicity of their envelopes. While frequency information is extracted by mechanical filtering of the cochlea, periodicity information is analyzed by temporal filter mechanisms in the brainstem. In the mammalian auditory midbrain envelope periodicity is represented in maps orthogonal to the representation of sound frequency. However, how periodicity is represented across the cortical surface of primary auditory cortex (AI) remains controversial. Using optical recording of intrinsic signals, we here demonstrate that a periodicity map exists in primary AI of the cat. While pure tone stimulation confirmed the well-known frequency gradient along the rostro-caudal axis of AI, stimulation with harmonic sounds revealed segregated bands of activation, indicating spatially localized preferences to specific periodicities along a dorso-ventral axis, nearly orthogonal to the tonotopic gradient. Analysis of the response locations revealed an average gradient of - 100 degrees +/- 10 degrees for the periodotopic, and -12 degrees +/- 18 degrees for the tonotopic map resulting in a mean angle difference of 88 degrees . The gradients were 0.65 +/- 0.08 mm/octave for periodotopy and 1.07 +/- 0.16 mm/octave for tonotopy indicating that more cortical territory is devoted to the representation of an octave along the tonotopic than along the periodotopic gradient. Our results suggest that the fundamental importance of pitch, as evident in human perception, is also reflected in the layout of cortical maps and that the orthogonal spatial organization of frequency and periodicity might be a more general cortical organization principle.

A computational model of human pitch strength and height judgments

A synchronization model of pitch processing was extended to include lateral inhibition mechanisms that have been observed in the mammalian mid brain, and information integration mechanisms consistent with observed changes to response fields of mammalian auditory cortex neurons. Model parameters for the inhibition mechanisms were adapted to fit model outputs to observed temporal dynamics of pitch height difference limens from the literature. Pitch strength was defined as the certainty of pitch height judgment, and was calculated by normalizing model responses by their mean. The model was adapted to fit experimental pitch strength data reported in the literature for pure tones and harmonic complexes. It was proposed that pitch height is first estimated in relation to patterns (or templates) of tonotopic activation on the auditory nerve for particular stimulus types. These patterns are stored in long term memory. This pitch height estimation primes cortical pitch neurons to integrate finely tuned pitch information from the inferior colliculus across the periodotopic and tonotopic dimensions. Predicted pitch strength for complexes of unresolved harmonics, iterated rippled noise and amplitude modulated tones using this model also conformed to behavioral data from the literature.

Maximum decoding abilities of temporal patterns and synchronized firings: application to auditory neurons responding to click trains and amplitude modulated white noise

Simultaneous recordings of an increasing number of neurons have recently become available, but few methods have been proposed to handle this activity. Here, we extract and investigate all the possible temporal neural activity patterns based on synchronized firings of neurons recorded on multiple electrodes, or based on bursts of single-electrode activity in cat primary auditory cortex. We apply this to responses to periodic click trains or sinusoïdal amplitude modulated noise by obtaining for each pattern its temporal modulation transfer function. An algorithm that maximizes the mutual information between all patterns and stimuli subsequently leads to the identification of patterns that optimally decode modulation frequency (MF). We show that stimulus information contained in multi-electrode synchronized firing is not redundant with single-electrode firings and leads to improved efficiency of MF decoding. We also show that the combined use of firing rate and temporal codes leads to a better discrimination of the MF.

Responses to diotic, dichotic, and alternating phase harmonic stimuli in the inferior colliculus of guinea pigs

Humans perceive a harmonic series as a single auditory object with a pitch equivalent to the fundamental frequency (F0) of the series. When harmonics are presented to alternate ears, the repetition rate of the waveform at each ear doubles. If the harmonics are resolved, then the pitch perceived is still equivalent to F0, suggesting the stimulus is binaurally integrated before pitch is processed. However, unresolved harmonics give rise to the doubling of pitch which would be expected from monaural processing (Bernstein and Oxenham, J. Acoust. Soc. Am., 113:3323-3334, 2003). We used similar stimuli to record responses of multi-unit clusters in the central nucleus of the inferior colliculus (IC) of anesthetized guinea pigs (urethane supplemented by fentanyl/fluanisone) to determine the nature of the representation of harmonic stimuli and to what extent there was binaural integration. We examined both the temporal and rate-tuning of IC clusters and found no evidence for binaural integration. Stimuli comprised all harmonics below 10 kHz with fundamental frequencies (F0) from 50 to 400 Hz in half-octave steps. In diotic conditions, all the harmonics were presented to both ears. In dichotic conditions, odd harmonics were presented to one ear and even harmonics to the other. Neural characteristic frequencies (CF, n = 85) were from 0.2 to 14.7 kHz; 29 had CFs below 1 kHz. The majority of clusters responded predominantly to the contralateral ear, with the dominance of the contralateral ear increasing with CF. With diotic stimuli, over half of the clusters (58%) had peaked firing rate vs. F0 functions. The most common peak F0 was 141 Hz. Almost all (98%) clusters phase locked diotically to an F0 of 50 Hz, and approximately 40% of clusters still phase locked significantly (Rayleigh coefficient >13.8) at the highest F0 tested (400 Hz). These results are consistent with the previous reports of responses to amplitude-modulated stimuli. Clusters phase locked significantly at a frequency equal to F0 for contralateral and diotic stimuli but at 2F0 for dichotic stimuli. We interpret these data as responses following the envelope periodicity in monaural channels rather than as a binaurally integrated representation.

A simulation of chopper neurons in the cochlear nucleus with wideband input from onset neurons

The unique temporal and spectral properties of chopper neurons in the cochlear nucleus cannot be fully explained by current popular models. A new model of sustained chopper neurons was therefore suggested based on the assumption that chopper neurons receive input both from onset neurons and the auditory nerve (Bahmer and Langner in Biol Cybern 95:4, 2006). As a result of the interaction of broadband input from onset neurons and narrowband input from the auditory nerve, the chopper neurons in our model are characterized by a remarkable combination of sharp frequency tuning to pure tones and faithful periodicity coding. Our simulations show that the width of the spectral integration of the onset neuron is crucial for both the precision of periodicity coding and their resolution of single components of sinusoidally amplitude-modulated sine waves. One may hypothesize, therefore, that it would be an advantage if the hearing system were able to adapt the spectral integration of onset neurons to varying stimulus conditions.

Distinct roles for onset and sustained activity in the neuronal code for temporal periodicity and acoustic envelope shape

Auditory neurons are selective for temporal sound information that is important for rhythm, pitch, and timbre perception. Traditional models assume that periodicity information is represented either by the discharge rate of tuned modulation filters or synchrony in the discharge pattern. Compelling evidence for an invariant rate or synchrony code, however, is lacking and neither of these models account for how the sound envelope shape is encoded. We examined the neuronal representation for envelope shape and periodicity in the cat central nucleus of the inferior colliculus (CNIC) with modulated broadband noise that lacks spectral cues and produces a periodicity pitch percept solely based on timing information. The modulation transfer functions of CNIC neurons differed dramatically across stimulus conditions with identical periodicity but different envelope shapes implying that shape contributed significantly to the neuronal response. We therefore devised a shuffled correlation procedure to quantify how periodicity and envelope shape contribute to the temporal discharge pattern. Sustained responses faithfully encode envelope shape at low modulation rates but deteriorate and fail to account for timing and envelope information at high rates. Surprisingly, onset responses accurately entrained to the stimulus and provided a means of encoding repetition information at high rates. Finally, we demonstrate that envelope shape information is accurately reflected in the population discharge pattern such that shape is readily discriminated for repetition frequencies up to approximately 100 Hz. These results argue against conventional rate- or synchrony-based codes and provide two complementary temporal mechanisms by which CNIC neurons can encode envelope shape and repetition information in natural sounds.

Activation of the serotonin 1A receptor alters the temporal characteristics of auditory responses in the inferior colliculus

Serotonin, like other neuromodulators, acts on a range of receptor types, but its effects also depend on the functional characteristics of the neurons responding to receptor activation. In the inferior colliculus (IC), an auditory midbrain nucleus, activation of a common serotonin (5-HT) receptor type, the 5-HT 1A receptor, depresses auditory-evoked responses in many neurons. Whether these effects occur differentially in different types of neurons is unknown. In the current study, the effects of iontophoretic application of the 5-HT 1A agonist 8-OH-DPAT on auditory responses were compared with the characteristic frequencies (CFs), recording depths, and control first-spike latencies of the same group of IC neurons. The 8-OH-DPAT-evoked change in response significantly correlated with first-spike latency across the population, so that response depressions were more prevalent in longer-latency neurons. The 8-OH-DPAT-evoked change in response did not correlate with CF or with recording depth. 8-OH-DPAT also altered the temporal characteristics of spike trains in a subset of neurons that fired multiple spikes in response to brief stimuli. For these neurons, activation of the 5-HT 1A receptor suppressed lagging spikes proportionally more than initial spikes. These results suggest that the 5-HT 1A receptor, by affecting the timing of the responses of both individual neurons and the neuron population, shifts the temporal profile of evoked activity within the IC.