Responses of neurons in the inferior colliculus to dynamic interaural phase cues: evidence for a mechanism of binaural adaptation

The perception of auditory motion in sighted and early blind individuals

Motion perception is a fundamental sensory task that plays a critical evolutionary role. In vision, motion processing is classically described using a motion energy model with spatiotemporally nonseparable filters suited for capturing the smooth continuous changes in spatial position over time afforded by moving objects. However, it is still not clear whether the filters underlying auditory motion discrimination are also continuous motion detectors or infer motion from comparing discrete sound locations over time (spatiotemporally separable). We used a psychophysical reverse correlation paradigm, where participants discriminated the direction of a motion signal in the presence of spatiotemporal noise, to determine whether the filters underlying auditory motion discrimination were spatiotemporally separable or nonseparable. We then examined whether these auditory motion filters were altered as a result of early blindness. We found that both sighted and early blind individuals have separable filters. However, early blind individuals show increased sensitivity to auditory motion, with reduced susceptibility to noise and filters that were more accurate in detecting motion onsets/offsets. Model simulations suggest that this reliance on separable filters is optimal given the limited spatial resolution of auditory input.

Do you hear what I see? How do early blind individuals experience object motion?

One of the most important tasks for 3D vision is tracking the movement of objects in space. The ability of early blind individuals to understand motion in the environment from noisy and unreliable auditory information is an impressive example of cortical adaptation that is only just beginning to be understood. Here, we compare visual and auditory motion processing, and discuss the effect of early blindness on the perception of auditory motion. Blindness leads to cross-modal recruitment of the visual motion area hMT+ for auditory motion processing. Meanwhile, the planum temporale, associated with auditory motion in sighted individuals, shows reduced selectivity for auditory motion. We discuss how this dramatic shift in the cortical basis of motion processing might influence the perceptual experience of motion in early blind individuals. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

The influence of envelope shape on the lateralization of amplitude-modulated, low-frequency sound

For abruptly gated sound, interaural time difference (ITD) cues at onset carry greater perceptual weight than those following. This research explored how envelope shape influences such carrier ITD weighting. Experiment 1 assessed the perceived lateralization of a tonal binaural beat that transitioned through ITD (diotic envelope, mean carrier frequency of 500 Hz). Listeners' left/right lateralization judgments were compared to those for static-ITD tones. For an 8 Hz sinusoidally amplitude-modulated envelope, ITD cues 24 ms after onset well-predicted reported sidedness. For an equivalent-duration "abrupt" envelope, which was unmodulated besides 20-ms onset/offset ramps, reported sidedness corresponded to ITDs near onset (e.g., 6 ms). However, unlike for sinusoidal amplitude modulation, ITDs toward offset seemingly also influenced perceived sidedness. Experiment 2 adjusted the duration of the offset ramp (25-75 ms) and found evidence for such offset weighting only for the most abrupt ramp tested. In experiment 3, an ITD was imposed on a brief segment of otherwise diotic filtered noise. Listeners discriminated right- from left-leading ITDs. In sinusoidal amplitude modulation, thresholds were lowest when the ITD segment occurred during rising amplitude. For the abrupt envelope, the lowest thresholds were observed when the segment occurred at either onset or offset. These experiments demonstrate the influence of envelope profile on carrier ITD sensitivity.

Neural coding and perception of auditory motion direction based on interaural time differences

While motion is important for parsing a complex auditory scene into perceptual objects, how it is encoded in the auditory system is unclear. Perceptual studies suggest that the ability to identify the direction of motion is limited by the duration of the moving sound, yet we can detect changes in interaural differences at even shorter durations. To understand the source of these distinct temporal limits, we recorded from single units in the inferior colliculus (IC) of unanesthetized rabbits in response to noise stimuli containing a brief segment with linearly time-varying interaural time difference ("ITD sweep") temporally embedded in interaurally uncorrelated noise. We also tested the ability of human listeners to either detect the ITD sweeps or identify the motion direction. Using a point-process model to separate the contributions of stimulus dependence and spiking history to single-neuron responses, we found that the neurons respond primarily by following the instantaneous ITD rather than exhibiting true direction selectivity. Furthermore, using an optimal classifier to decode the single-neuron responses, we found that neural threshold durations of ITD sweeps for both direction identification and detection overlapped with human threshold durations even though the average response of the neurons could track the instantaneous ITD beyond psychophysical limits. Our results suggest that the IC does not explicitly encode motion direction, but internal neural noise may limit the speed at which we can identify the direction of motion.NEW & NOTEWORTHY Recognizing motion and identifying an object's trajectory are important for parsing a complex auditory scene, but how we do so is unclear. We show that neurons in the auditory midbrain do not exhibit direction selectivity as found in the visual system but instead follow the trajectory of the motion in their temporal firing patterns. Our results suggest that the inherent variability in neural firings may limit our ability to identify motion direction at short durations.

Representation of Auditory Motion Directions and Sound Source Locations in the Human Planum Temporale

The ability to compute the location and direction of sounds is a crucial perceptual skill to efficiently interact with dynamic environments. How the human brain implements spatial hearing is, however, poorly understood. In our study, we used fMRI to characterize the brain activity of male and female humans listening to sounds moving left, right, up, and down as well as static sounds. Whole-brain univariate results contrasting moving and static sounds varying in their location revealed a robust functional preference for auditory motion in bilateral human planum temporale (hPT). Using independently localized hPT, we show that this region contains information about auditory motion directions and, to a lesser extent, sound source locations. Moreover, hPT showed an axis of motion organization reminiscent of the functional organization of the middle-temporal cortex (hMT+/V5) for vision. Importantly, whereas motion direction and location rely on partially shared pattern geometries in hPT, as demonstrated by successful cross-condition decoding, the responses elicited by static and moving sounds were, however, significantly distinct. Altogether, our results demonstrate that the hPT codes for auditory motion and location but that the underlying neural computation linked to motion processing is more reliable and partially distinct from the one supporting sound source location.SIGNIFICANCE STATEMENT Compared with what we know about visual motion, little is known about how the brain implements spatial hearing. Our study reveals that motion directions and sound source locations can be reliably decoded in the human planum temporale (hPT) and that they rely on partially shared pattern geometries. Our study, therefore, sheds important new light on how computing the location or direction of sounds is implemented in the human auditory cortex by showing that those two computations rely on partially shared neural codes. Furthermore, our results show that the neural representation of moving sounds in hPT follows a "preferred axis of motion" organization, reminiscent of the coding mechanisms typically observed in the occipital middle-temporal cortex (hMT+/V5) region for computing visual motion.

Neural binaural sensitivity at high sound speeds: Single cell responses in cat midbrain to fast-changing interaural time differences of broadband sounds

Relative motion between the body and the outside world is a rich source of information. Neural selectivity to motion is well-established in several sensory systems, but is controversial in hearing. This study examines neural sensitivity to changes in the instantaneous interaural time difference of sounds at the two ears. Midbrain neurons track such changes up to extremely high speeds, show only a coarse dependence of firing rate on speed, and lack directional selectivity. These results argue against the presence of selectivity to auditory motion at the level of the midbrain, but reveal an acuity which enables coding of fast-fluctuating binaural cues in realistic sound environments.

Auditory and Visual Motion Processing and Integration in the Primate Cerebral Cortex

The ability of animals to detect motion is critical for survival, and errors or even delays in motion perception may prove costly. In the natural world, moving objects in the visual field often produce concurrent sounds. Thus, it can highly advantageous to detect motion elicited from sensory signals of either modality, and to integrate them to produce more reliable motion perception. A great deal of progress has been made in understanding how visual motion perception is governed by the activity of single neurons in the primate cerebral cortex, but far less progress has been made in understanding both auditory motion and audiovisual motion integration. Here we, review the key cortical regions for motion processing, focussing on translational motion. We compare the representations of space and motion in the visual and auditory systems, and examine how single neurons in these two sensory systems encode the direction of motion. We also discuss the way in which humans integrate of audio and visual motion cues, and the regions of the cortex that may mediate this process.

Neural tracking of auditory motion is reflected by delta phase and alpha power of EEG

It is of increasing practical interest to be able to decode the spatial characteristics of an auditory scene from electrophysiological signals. However, the cortical representation of auditory space is not well characterized, and it is unclear how cortical activity reflects the time-varying location of a moving sound. Recently, we demonstrated that cortical response measures to discrete noise bursts can be decoded to determine their origin in space. Here we build on these findings to investigate the cortical representation of a continuously moving auditory stimulus using scalp recorded electroencephalography (EEG). In a first experiment, subjects listened to pink noise over headphones which was spectro-temporally modified to be perceived as randomly moving on a semi-circular trajectory in the horizontal plane. While subjects listened to the stimuli, we recorded their EEG using a 128-channel acquisition system. The data were analysed by 1) building a linear regression model (decoder) mapping the relationship between the stimulus location and a training set of EEG data, and 2) using the decoder to reconstruct an estimate of the time-varying sound source azimuth from the EEG data. The results showed that we can decode sound trajectory with a reconstruction accuracy significantly above chance level. Specifically, we found that the phase of delta (<2 Hz) and power of alpha (8-12 Hz) EEG track the dynamics of a moving auditory object. In a follow-up experiment, we replaced the noise with pulse train stimuli containing only interaural level and time differences (ILDs and ITDs respectively). This allowed us to investigate whether our trajectory decoding is sensitive to both acoustic cues. We found that the sound trajectory can be decoded for both ILD and ITD stimuli. Moreover, their neural signatures were similar and even allowed successful cross-cue classification. This supports the notion of integrated processing of ILD and ITD at the cortical level. These results are particularly relevant for application in devices such as cognitively controlled hearing aids and for the evaluation of virtual acoustic environments.

Response adaptation in the barn owl's auditory space map

Response adaptation is the change of the firing rate of neurons induced by a preceding stimulus. It can be found in many sensory systems and throughout the auditory pathway. We investigated response adaptation in the external nucleus of the inferior colliculus (ICX) of barn owls ( Tyto furcata), a nocturnal bird of prey and specialist in sound localization. Individual neurons in the ICX represent locations in auditory space by maximally responding to combinations of interaural time and level differences (ITD and ILD). Neuronal responses were recorded extracellularly under ketamine-diazepam anesthesia. Response adaptation was observed in three double stimulation paradigms. In two paradigms, the same binaural parameters for both stimuli were chosen. A variation of the level of the second stimulus yielded a level increase sufficient to compensate for adaptation around 5 dB. Introducing a silent interstimulus interval (ISI) resulted in recovery from adaptation. The time course of recovery was followed by varying the ISI, and full recovery was found after an ISI of 50 ms. In a third paradigm, the ITD of the second stimulus was varied to investigate the representation of ITD under adaptive conditions. We found that adaptation led to an increased precision and improved selectivity while the best ITD was stable. These changes of representation remained for longer ISIs than were needed to recover from response adaptation at the best ITD. Stimuli with non-best ITDs could also induce similar adaptive effects if the neurons responded to these ITDs. NEW & NOTEWORTHY We demonstrate and characterize response adaptation in neurons of the auditory space map in the barn owl's midbrain with acoustic double-stimulation paradigms. An increase of the second level by 5 dB compensated for the observed adaptive effect. Recovery from adaptation was faster than in upstream nuclei of the auditory pathway. Our results also show that response adaptation might improve precision and selectivity in the representation of interaural time difference.

Neural coding of time-varying interaural time differences and time-varying amplitude in the inferior colliculus

Binaural cues occurring in natural environments are frequently time varying, either from the motion of a sound source or through interactions between the cues produced by multiple sources. Yet, a broad understanding of how the auditory system processes dynamic binaural cues is still lacking. In the current study, we directly compared neural responses in the inferior colliculus (IC) of unanesthetized rabbits to broadband noise with time-varying interaural time differences (ITD) with responses to noise with sinusoidal amplitude modulation (SAM) over a wide range of modulation frequencies. On the basis of prior research, we hypothesized that the IC, one of the first stages to exhibit tuning of firing rate to modulation frequency, might use a common mechanism to encode time-varying information in general. Instead, we found weaker temporal coding for dynamic ITD compared with amplitude modulation and stronger effects of adaptation for amplitude modulation. The differences in temporal coding of dynamic ITD compared with SAM at the single-neuron level could be a neural correlate of "binaural sluggishness," the inability to perceive fluctuations in time-varying binaural cues at high modulation frequencies, for which a physiological explanation has so far remained elusive. At ITD-variation frequencies of 64 Hz and above, where a temporal code was less effective, noise with a dynamic ITD could still be distinguished from noise with a constant ITD through differences in average firing rate in many neurons, suggesting a frequency-dependent tradeoff between rate and temporal coding of time-varying binaural information.NEW & NOTEWORTHY Humans use time-varying binaural cues to parse auditory scenes comprising multiple sound sources and reverberation. However, the neural mechanisms for doing so are poorly understood. Our results demonstrate a potential neural correlate for the reduced detectability of fluctuations in time-varying binaural information at high speeds, as occurs in reverberation. The results also suggest that the neural mechanisms for processing time-varying binaural and monaural cues are largely distinct.

Auditory motion-specific mechanisms in the primate brain

This work examined the mechanisms underlying auditory motion processing in the auditory cortex of awake monkeys using functional magnetic resonance imaging (fMRI). We tested to what extent auditory motion analysis can be explained by the linear combination of static spatial mechanisms, spectrotemporal processes, and their interaction. We found that the posterior auditory cortex, including A1 and the surrounding caudal belt and parabelt, is involved in auditory motion analysis. Static spatial and spectrotemporal processes were able to fully explain motion-induced activation in most parts of the auditory cortex, including A1, but not in circumscribed regions of the posterior belt and parabelt cortex. We show that in these regions motion-specific processes contribute to the activation, providing the first demonstration that auditory motion is not simply deduced from changes in static spatial location. These results demonstrate that parallel mechanisms for motion and static spatial analysis coexist within the auditory dorsal stream.

A novel BK channel-targeted peptide suppresses sound evoked activity in the mouse inferior colliculus

Large conductance calcium-activated (BK) channels are broadly expressed in neurons and muscle where they modulate cellular activity. Decades of research support an interest in pharmaceutical applications for modulating BK channel function. Here we report a novel BK channel-targeted peptide with functional activity in vitro and in vivo. This 9-amino acid peptide, LS3, has a unique action, suppressing channel gating rather than blocking the pore of heterologously expressed human BK channels. With an IC₅₀ in the high picomolar range, the apparent affinity is higher than known high affinity BK channel toxins. LS3 suppresses locomotor activity via a BK channel-specific mechanism in wild-type or BK channel-humanized Caenorhabditis elegans. Topical application on the dural surface of the auditory midbrain in mouse suppresses sound evoked neural activity, similar to a well-characterized pore blocker of the BK channel. Moreover, this novel ion channel-targeted peptide rapidly crosses the BBB after systemic delivery to modulate auditory processing. Thus, a potent BK channel peptide modulator is open to neurological applications, such as preventing audiogenic seizures that originate in the auditory midbrain.

Auditory compensation for head rotation is incomplete

Hearing is confronted by a similar problem to vision when the observer moves. The image motion that is created remains ambiguous until the observer knows the velocity of eye and/or head. One way the visual system solves this problem is to use motor commands, proprioception, and vestibular information. These "extraretinal signals" compensate for self-movement, converting image motion into head-centered coordinates, although not always perfectly. We investigated whether the auditory system also transforms coordinates by examining the degree of compensation for head rotation when judging a moving sound. Real-time recordings of head motion were used to change the "movement gain" relating head movement to source movement across a loudspeaker array. We then determined psychophysically the gain that corresponded to a perceptually stationary source. Experiment 1 showed that the gain was small and positive for a wide range of trained head speeds. Hence, listeners perceived a stationary source as moving slightly opposite to the head rotation, in much the same way that observers see stationary visual objects move against a smooth pursuit eye movement. Experiment 2 showed the degree of compensation remained the same for sounds presented at different azimuths, although the precision of performance declined when the sound was eccentric. We discuss two possible explanations for incomplete compensation, one based on differences in the accuracy of signals encoding image motion and self-movement and one concerning statistical optimization that sacrifices accuracy for precision. We then consider the degree to which such explanations can be applied to auditory motion perception in moving listeners. (PsycINFO Database Record

Stimulus-specific adaptation to visual but not auditory motion direction in the barn owl's optic tectum

Whether the auditory and visual systems use a similar coding strategy to represent motion direction is an open question. We investigated this question in the barn owl's optic tectum (OT) testing stimulus-specific adaptation (SSA) to the direction of motion. SSA, the reduction of the response to a repetitive stimulus that does not generalize to other stimuli, has been well established in OT neurons. SSA suggests a separate representation of the adapted stimulus in upstream pathways. So far, only SSA to static stimuli has been studied in the OT. Here, we examined adaptation to moving auditory and visual stimuli. SSA to motion direction was examined using repeated presentations of moving stimuli, occasionally switching motion to the opposite direction. Acoustic motion was either mimicked by varying binaural spatial cues or implemented in free field using a speaker array. While OT neurons displayed SSA to motion direction in visual space, neither stimulation paradigms elicited significant SSA to auditory motion direction. These findings show a qualitative difference in how auditory and visual motion is processed in the OT and support the existence of dedicated circuitry for representing motion direction in the early stages of visual but not the auditory system.

Sensitivity to Auditory Velocity Contrast

A natural auditory scene often contains sound moving at varying velocities. Using a velocity contrast paradigm, we compared sensitivity to velocity changes between continuous and discontinuous trajectories. Subjects compared the velocities of two stimulus intervals that moved along a single trajectory, with and without a 1 second inter stimulus interval (ISI). We found thresholds were threefold larger for velocity increases in the instantaneous velocity change condition, as compared to instantaneous velocity decreases or thresholds for the delayed velocity transition condition. This result cannot be explained by the current static "snapshot" model of auditory motion perception and suggest a continuous process where the percept of velocity is influenced by previous history of stimulation.

The Perception of Auditory Motion

The growing availability of efficient and relatively inexpensive virtual auditory display technology has provided new research platforms to explore the perception of auditory motion. At the same time, deployment of these technologies in command and control as well as in entertainment roles is generating an increasing need to better understand the complex processes underlying auditory motion perception. This is a particularly challenging processing feat because it involves the rapid deconvolution of the relative change in the locations of sound sources produced by rotational and translations of the head in space (self-motion) to enable the perception of actual source motion. The fact that we perceive our auditory world to be stable despite almost continual movement of the head demonstrates the efficiency and effectiveness of this process. This review examines the acoustical basis of auditory motion perception and a wide range of psychophysical, electrophysiological, and cortical imaging studies that have probed the limits and possible mechanisms underlying this perception.

Moving Objects in the Barn Owl's Auditory World

Barn owls are keen hunters of moving prey. They have evolved an auditory system with impressive anatomical and physiological specializations for localizing their prey. Here we present behavioural data on the owl's sensitivity for discriminating acoustic motion direction in azimuth that, for the first time, allow a direct comparison of neuronal and perceptual sensitivity for acoustic motion in the same model species. We trained two birds to report a change in motion direction within a series of repeating wideband noise stimuli. For any trial the starting point, motion direction, velocity (53-2400°/s), duration (30-225 ms) and angular range (12-72°) of the noise sweeps were randomized. Each test stimulus had a motion direction being opposite to that of the reference stimuli. Stimuli were presented in the frontal or the lateral auditory space. The angular extent of the motion had a large effect on the owl's discrimination sensitivity allowing a better discrimination for a larger angular range of the motion. In contrast, stimulus velocity or stimulus duration had a smaller, although significant effect. Overall there was no difference in the owls' behavioural performance between "inward" noise sweeps (moving from lateral to frontal) compared to "outward" noise sweeps (moving from frontal to lateral). The owls did, however, respond more often to stimuli with changing motion direction in the frontal compared to the lateral space. The results of the behavioural experiments are discussed in relation to the neuronal representation of motion cues in the barn owl auditory midbrain.

Modulation of Auditory Motion Processing by Visual Motion

Neurophysiological findings suggested that auditory and visual motion information is integrated at an early stage of auditory cortical processing, already starting in primary auditory cortex. Here, the effect of visual motion on processing of auditory motion was investigated by employing electrotomography in combination with free-field sound motion. A delayed-motion paradigm was used in which the onset of motion was delayed relative to the onset of an initially stationary stimulus. The results indicated that activity related to the motion-onset response, a neurophysiological correlate of auditory motion processing, interacts with the processing of visual motion at quite early stages of auditory analysis in the dimensions of both the time and the location of cortical processing. A modulation of auditory motion processing by concurrent visual motion was found already around 170 ms after motion onset (cN1 component) in the regions of primary auditory cortex and posterior superior temporal gyrus: Incongruent visual motion enhanced the auditory motion onset response in auditory regions ipsilateral to the sound motion stimulus, thus reducing the pattern of contralaterality observed with unimodal auditory stimuli. No modulation was found in parietal cortex nor around 250 ms after motion onset (cP2 component) in any auditory region of interest. These findings may reflect the integration of auditory and visual motion information in low-level areas of the auditory cortical system at relatively early points in time.

Saliency mapping in the optic tectum and its relationship to habituation

Habituation of the orienting response has long served as a model system for studying fundamental psychological phenomena such as learning, attention, decisions, and surprise. In this article, we review an emerging hypothesis that the evolutionary role of the superior colliculus (SC) in mammals or its homolog in birds, the optic tectum (OT), is to select the most salient target and send this information to the appropriate brain regions to control the body and brain orienting responses. Recent studies have begun to reveal mechanisms of how saliency is computed in the OT/SC, demonstrating a striking similarity between mammals and birds. The saliency of a target can be determined by how different it is from the surrounding objects, by how different it is from its history (that is habituation) and by how relevant it is for the task at hand. Here, we will first review evidence, mostly from primates and barn owls, that all three types of saliency computations are linked in the OT/SC. We will then focus more on neural adaptation in the OT and its possible link to temporal saliency and habituation.

Differences in evoked potentials during the active processing of sound location and motion

Difference in the processing of motion and static sounds in the human cortex was studied by electroencephalography with subjects performing an active discrimination task. Sound bursts were presented in the acoustic free-field between 47° to the left and 47° to the right under three different stimulus conditions: (i) static, (ii) leftward motion, and (iii) rightward motion. In an active oddball design, subject was asked to detect target stimuli which were randomly embedded within a stream of frequently occurring non-target events (i.e. 'standards') and rare non-target stimuli (i.e. 'deviants'). The respective acoustic stimuli were presented in blocks with each stimulus type presented in either of three stimulus conditions: as target, as non-target, or as standard. The analysis focussed on the event related potentials evoked by the different stimulus types under the respective standard condition. Same as in previous studies, all three different acoustic stimuli elicited the obligatory P1/N1/P2 complex in the range of 50-200 ms. However, comparisons of ERPs elicited by static stimuli and both kinds of motion stimuli yielded differences as early as ~100 ms after stimulus-onset, i.e. at the level of the exogenous N1 and P2 components. Differences in signal amplitudes were also found in a time window 300-400 ms ('d300-400 ms' component in 'motion-minus-static' difference wave). For motion stimuli, the N1 amplitudes were larger over the hemisphere contralateral to the origin of motion, while for static stimuli N1 amplitudes over both hemispheres were in the same range. Contrary to the N1 component, the ERP in the 'd300-400 ms' time period showed stronger responses over the hemisphere contralateral to motion termination, with the static stimuli again yielding equal bilateral amplitudes. For the P2 component a motion-specific effect with larger signal amplitudes over the left hemisphere was found compared to static stimuli. The presently documented N1 components comply with the results of previous studies on auditory space processing and suggest a contralateral dominance during the process of cortical integration of spatial acoustic information. Additionally, the cortical activity in the 'd300-400 ms' time period indicates, that in addition to the motion origin (as reflected by the N1) also the direction of motion (leftward/ rightward motion) or rather motion termination is cortically encoded. These electrophysiological results are in accordance with the 'snap shot' hypothesis, assuming that auditory motion processing is not based on a genuine motion-sensitive system, but rather on a comparison process of spatial positions of motion origin (onset) and motion termination (offset). Still, specificities of the present P2 component provides evidence for additional motion-specific processes possibly associated with the evaluation of motion-specific attributes, i.e. motion direction and/or velocity which is preponderant in the left hemisphere.

Stimulus change detection in phasic auditory units in the frog midbrain: frequency and ear specific adaptation

Neural adaptation, a reduction in the response to a maintained stimulus, is an important mechanism for detecting stimulus change. Contributing to change detection is the fact that adaptation is often stimulus specific: adaptation to a particular stimulus reduces excitability to a specific subset of stimuli, while the ability to respond to other stimuli is unaffected. Phasic cells (e.g., cells responding to stimulus onset) are good candidates for detecting the most rapid changes in natural auditory scenes, as they exhibit fast and complete adaptation to an initial stimulus presentation. We made recordings of single phasic auditory units in the frog midbrain to determine if adaptation was specific to stimulus frequency and ear of input. In response to an instantaneous frequency step in a tone, 28% of phasic cells exhibited frequency specific adaptation based on a relative frequency change (delta-f=±16%). Frequency specific adaptation was not limited to frequency steps, however, as adaptation was also overcome during continuous frequency modulated stimuli and in response to spectral transients interrupting tones. The results suggest that adaptation is separated for peripheral (e.g., frequency) channels. This was tested directly using dichotic stimuli. In 45% of binaural phasic units, adaptation was ear specific: adaptation to stimulation of one ear did not affect responses to stimulation of the other ear. Thus, adaptation exhibited specificity for stimulus frequency and lateralization at the level of the midbrain. This mechanism could be employed to detect rapid stimulus change within and between sound sources in complex acoustic environments.

Frequency discrimination and stimulus deviance in the inferior colliculus and cochlear nucleus

Auditory neurons that exhibit stimulus-specific adaptation (SSA) decrease their response to common tones while retaining responsiveness to rare ones. We recorded single-unit responses from the inferior colliculus (IC) where SSA is known to occur and we explored for the first time SSA in the cochlear nucleus (CN) of rats. We assessed an important functional outcome of SSA, the extent to which frequency discriminability depends on sensory context. For this purpose, pure tones were presented in an oddball sequence as standard (high probability of occurrence) or deviant (low probability of occurrence) stimuli. To study frequency discriminability under different probability contexts, we varied the probability of occurrence and the frequency separation between tones. The neuronal sensitivity was estimated in terms of spike-count probability using signal detection theory. We reproduced the finding that many neurons in the IC exhibited SSA, but we did not observe significant SSA in our CN sample. We concluded that strong SSA is not a ubiquitous phenomenon in the CN. As predicted, frequency discriminability was enhanced in IC when stimuli were presented in an oddball context, and this enhancement was correlated with the degree of SSA shown by the neurons. In contrast, frequency discrimination by CN neurons was independent of stimulus context. Our results demonstrated that SSA is not widespread along the entire auditory pathway, and suggest that SSA increases frequency discriminability of single neurons beyond that expected from their tuning curves.

No evidence for ITD-specific adaptation in the frequency following response

Neurons sensitive to interaural time differences (ITDs) in the fine structure of low-frequency signals have been found in binaurally responsive auditory nuclei in a wide range of species. The present study investigated whether the frequency following response (FFR) would show evidence for neurons “tuned” to ITD in humans. The FFR is a scalp-recorded measure of sustained phase-locked brainstem activity that has been shown to follow the frequency of low-frequency tones. The magnitude of the FFR often decreases over time for tones of long duration. The present study investigated whether this adaptation effect is ITD specific.The FFR to a 100-ms, 80-dB SPL, 504-Hz target tone was measured for ten subjects. The target was preceded by a 200-ms, 80-dB SPL, 504-Hz adaptor. The target always led by 0.5 ms in the left ear. The adaptor led either in the left ear or in the right ear by 0.5 ms. Stimuli (adaptor + target = pair) were presented in alternating polarity at a rate of 1.81 Hz. We used a “vertical” montage (+Fz, – C7, ground = Fpz) for which the FFR is assumed to reflect phase-locked neural activity from rostral generators in the brainstem. The averaged FFR waveforms for each polarity were subtracted, to enhance temporal fine structure responses. The results showed significant adaptation effects in the spectral magnitude of the FFR. However, adaptation was not larger when the adaptor had the same ITD as the target than when the ITD of the adaptor differed from that of the target. Thus, the current data provide no evidence that the spectral magnitude of the scalp-recorded FFR provides a non-invasive indicator of ITD-specific neural activation.

Stimulus-specific adaptation, habituation and change detection in the gaze control system

This prospect article addresses the neurobiology of detecting and responding to changes or unexpected events. Change detection is an ongoing computational task performed by the brain as part of the broader process of saliency mapping and selection of the next target for attention. In the optic tectum (OT) of the barn owl, the probability of the stimulus has a dramatic influence on the neural response to that stimulus; rare or deviant stimuli induce stronger responses compared to common stimuli. This phenomenon, known as stimulus-specific adaptation, has recently attracted scientific interest because of its possible role in change detection. In the barn owl's OT, it may underlie the ability to orient specifically to unexpected events and is therefore opening new directions for research on the neurobiology of fundamental psychological phenomena such as habituation, attention, and surprise.

Electrical neuroimaging during auditory motion aftereffects reveals that auditory motion processing is motion sensitive but not direction selective

Following prolonged exposure to adaptor sounds moving in a single direction, participants may perceive stationary-probe sounds as moving in the opposite direction [direction-selective auditory motion aftereffect (aMAE)] and be less sensitive to motion of any probe sounds that are actually moving (motion-sensitive aMAE). The neural mechanisms of aMAEs, and notably whether they are due to adaptation of direction-selective motion detectors, as found in vision, is presently unknown and would provide critical insight into auditory motion processing. We measured human behavioral responses and auditory evoked potentials to probe sounds following four types of moving-adaptor sounds: leftward and rightward unidirectional, bidirectional, and stationary. Behavioral data replicated both direction-selective and motion-sensitive aMAEs. Electrical neuroimaging analyses of auditory evoked potentials to stationary probes revealed no significant difference in either global field power (GFP) or scalp topography between leftward and rightward conditions, suggesting that aMAEs are not based on adaptation of direction-selective motion detectors. By contrast, the bidirectional and stationary conditions differed significantly in the stationary-probe GFP at 200 ms poststimulus onset without concomitant topographic modulation, indicative of a difference in the response strength between statistically indistinguishable intracranial generators. The magnitude of this GFP difference was positively correlated with the magnitude of the motion-sensitive aMAE, supporting the functional relevance of the neurophysiological measures. Electrical source estimations revealed that the GFP difference followed from a modulation of activity in predominantly right hemisphere frontal-temporal-parietal brain regions previously implicated in auditory motion processing. Our collective results suggest that auditory motion processing relies on motion-sensitive, but, in contrast to vision, non-direction-selective mechanisms.

Adaptation in the auditory midbrain of the barn owl (Tyto alba) induced by tonal double stimulation

During hunting, the barn owl typically listens to several successive sounds as generated, for example, by rustling mice. As auditory cells exhibit adaptive coding, the earlier stimuli may influence the detection of the later stimuli. This situation was mimicked with two double-stimulus paradigms, and adaptation was investigated in neurons of the barn owl's central nucleus of the inferior colliculus. Each double-stimulus paradigm consisted of a first or reference stimulus and a second stimulus (probe). In one paradigm (second level tuning), the probe level was varied, whereas in the other paradigm (inter-stimulus interval tuning), the stimulus interval between the first and second stimulus was changed systematically. Neurons were stimulated with monaural pure tones at the best frequency, while the response was recorded extracellularly. The responses to the probe were significantly reduced when the reference stimulus and probe had the same level and the inter-stimulus interval was short. This indicated response adaptation, which could be compensated for by an increase of the probe level of 5-7 dB over the reference level, if the latter was in the lower half of the dynamic range of a neuron's rate-level function. Recovery from adaptation could be best fitted with a double exponential showing a fast (1.25 ms) and a slow (800 ms) component. These results suggest that neurons in the auditory system show dynamic coding properties to tonal double stimulation that might be relevant for faithful upstream signal propagation. Furthermore, the overall stimulus level of the masker also seems to affect the recovery capabilities of auditory neurons.

Auditory Spatial Processing in the Human Cortex

The auditory system codes spatial locations in a way that deviates from the spatial representations found in other modalities. This difference is especially striking in the cortex, where neurons form topographical maps of visual and tactile space but where auditory space is represented through a population rate code. In this hemifield code, sound source location is represented in the activity of two widely tuned opponent populations, one tuned to the right and the other to the left side of auditory space. Scientists are only beginning to uncover how this coding strategy adapts to various spatial processing demands. This review presents the current understanding of auditory spatial processing in the cortex. To this end, the authors consider how various implementations of the hemifield code may exist within the auditory cortex and how these may be modulated by the stimulation and task context. As a result, a coherent set of neural strategies for auditory spatial processing emerges.

Adaptation of binaural processing in the adult brainstem induced by ambient noise

Interaural differences in stimulus intensity and timing are major cues for sound localization. In mammals, these cues are first processed in the lateral and medial superior olive by interaction of excitatory and inhibitory synaptic inputs from ipsi- and contralateral cochlear nucleus neurons. To preserve sound localization acuity following changes in the acoustic environment, the processing of these binaural cues needs neuronal adaptation. Recent studies have shown that binaural sensitivity adapts to stimulation history within milliseconds, but the actual extent of binaural adaptation is unknown. In the current study, we investigated long-term effects on binaural sensitivity using extracellular in vivo recordings from single neurons in the dorsal nucleus of the lateral lemniscus that inherit their binaural properties directly from the lateral and medial superior olives. In contrast to most previous studies, we used a noninvasive approach to influence this processing. Adult gerbils were exposed for 2 weeks to moderate noise with no stable binaural cue. We found monaural response properties to be unaffected by this measure. However, neuronal sensitivity to binaural cues was reversibly altered for a few days. Computational models of sensitivity to interaural time and level differences suggest that upregulation of inhibition in the superior olivary complex can explain the electrophysiological data.

Binaural image position distributions for phase-shifted low frequency tone bursts

This experiment was designed to yield precise measures of the statistical properties of perceived sound images. Results are reported for listeners' judgments of intracranial sound image lateral positions in response to binaural tone burst stimuli (250 Hz, 50 ms) with varying interaural phase differences, conditional on the absence or presence of a (left or right) reference monaural tone burst (also 250 Hz, 50 ms) ending 500 ms prior to the test signal. The monaural-reference shifted the position distributions toward the opposite side of the head. The position distribution variance and skewness depended on the mean of the position distribution, not on the interaural phase difference of the stimulus. The standard deviation increased as the mean moved laterally from midline. Near the midline the position distributions were skewed ipsilaterally. Near either ear they were skewed toward the midline. The results suggest that the most important noise limiting performance originates central to brainstem coincidence detector networks.

The effects of interaural time difference and intensity on the coding of low-frequency sounds in the mammalian midbrain

We examined how changes in intensity and interaural time difference (ITD) influenced the coding of low-frequency sounds in the inferior colliculus of male gerbils at both the single neuron and population levels. We found that changes in intensity along the positive slope of the rate-level function (RLF) evoked changes in spectrotemporal filtering that influenced the overall timing of spike events but preserved their precision across trials such that the decoding of single neuron responses was not affected. In contrast, changes in ITD did not trigger changes in spectrotemporal filtering, but did have strong effects on the precision of spike events and, consequently, on decoder performance. However, changes in ITD had opposing effects in the two brain hemispheres and, thus, canceled out at the population level. These results were similar with and without the addition of background noise. We also found that the effects of changes in intensity along the negative slope of the RLF were different from the effects of changes in intensity along the positive slope in that they evoked changes in both spectrotemporal filtering and in the precision of spike events across trials, as well as in decoder performance. These results demonstrate that, at least at moderate intensities, the auditory system employs different strategies at the single neuron and population levels simultaneously to ensure that the coding of sounds is robust to changes in other stimulus features.

Level-dependent latency shifts quantified through binaural processing

The mammalian binaural system compares the timing of monaural inputs with microsecond precision. This temporal precision is required for localizing sounds in azimuth. However, temporal features of the monaural inputs, in particular their latencies, highly depend on the overall sound level. In a combined psychophysical, electrophysiological, and modeling approach, we investigate how level-dependent latency shifts of the monaural responses are reflected in the perception and neural representation of interaural time differences. We exploit the sensitivity of the binaural system to the timing of high-frequency stimuli with binaurally incongruent envelopes. Using these novel stimuli, both the perceptually adjusted interaural time differences and the time differences extracted from electrophysiological recordings systematically depend on overall sound pressure level. The perceptual and electrophysiological time differences of the envelopes can be explained in an existing model of temporal integration only if a level-dependent firing threshold is added. Such an adjustment of firing threshold provides a temporally accurate neural code of the temporal structure of a stimulus and its binaural disparities independent of overall sound level.

Mechanisms of Sound Localization in Mammals

The ability to determine the location of a sound source is fundamental to hearing. However, auditory space is not represented in any systematic manner on the basilar membrane of the cochlea, the sensory surface of the receptor organ for hearing. Understanding the means by which sensitivity to spatial cues is computed in central neurons can therefore contribute to our understanding of the basic nature of complex neural representations. We review recent evidence concerning the nature of the neural representation of auditory space in the mammalian brain and elaborate on recent advances in the understanding of mammalian subcortical processing of auditory spatial cues that challenge the “textbook” version of sound localization, in particular brain mechanisms contributing to binaural hearing.

Shared Cortical Systems for Processing of Horizontal and Vertical Sound Motion

Cortical processing of horizontal and vertical sound motion in free-field space was investigated using high-density electroencephalography in combination with standardized low-resolution brain electromagnetic tomography (sLORETA). Eighteen subjects heard sound stimuli that, after an initial stationary phase in a central position, started to move centrifugally, either to the left, to the right, upward, or downward. The delayed onset of both horizontal and vertical motion elicited a specific motion-onset response (MOR), resulting in widely distributed activations, with prominent maxima in primary and nonprimary auditory cortices, insula, and parietal lobe. The comparison of MORs to horizontal and vertical motion orientations did not indicate any significant differences in latency or topography. Contrasting the sLORETA solutions for the two motion orientations revealed only marginal activation in postcentral gyrus. These data are consistent with the notion that azimuth and elevation components of dynamic auditory spatial information are processed in common, rather than separate, cortical substrates. Furthermore, the findings support the assumption that the MOR originates at a stage of auditory analysis after the different spatial cues (interaural and monaural spectral cues) have been integrated into a unified space code.

Processing temporal modulations in binaural and monaural auditory stimuli by neurons in the inferior colliculus and auditory cortex

Processing dynamic changes in the stimulus stream is a major task for sensory systems. In the auditory system, an increase in the temporal integration window between the inferior colliculus (IC) and auditory cortex is well known for monaural signals such as amplitude modulation, but a similar increase with binaural signals has not been demonstrated. To examine the limits of binaural temporal processing at these brain levels, we used the binaural beat stimulus, which causes a fluctuating interaural phase difference, while recording from neurons in the unanesthetized rabbit. We found that the cutoff frequency for neural synchronization to the binaural beat frequency (BBF) decreased between the IC and auditory cortex, and that this decrease was associated with an increase in the group delay. These features indicate that there is an increased temporal integration window in the cortex compared to the IC, complementing that seen with monaural signals. Comparable measurements of responses to amplitude modulation showed that the monaural and binaural temporal integration windows at the cortical level were quantitatively as well as qualitatively similar, suggesting that intrinsic membrane properties and afferent synapses to the cortical neurons govern the dynamic processing. The upper limits of synchronization to the BBF and the band-pass tuning characteristics of cortical neurons are a close match to human psychophysics.

Effect of auditory motion velocity on reaction time and cortical processes

The study investigated the processing of sound motion, employing a psychophysical motion discrimination task in combination with electroencephalography. Following stationary auditory stimulation from a central space position, the onset of left- and rightward motion elicited a specific cortical response that was lateralized to the hemisphere contralateral to the direction of motion. The contralaterality of the motion onset response decreased when the velocity was reduced. Higher motion velocity was associated with larger and earlier cortical responses and with shorter reaction times to motion onset. The results indicate a close correspondence of brain activity and behavioral performance in auditory motion detection.

Interaural temporal and coherence cues jointly contribute to successful sound movement perception and activation of parietal cortex

The perception of movement in the auditory modality requires dynamic changes in the input that reaches the two ears (e.g. sequential changes of interaural time differences; dynamic ITDs). However, it is still unclear as to what extent these temporal cues interact with other interaural cues to determine successful movement perception, and which brain regions are involved in sound movement processing. Here, we presented trains of white-noise bursts containing either static or dynamic ITDs, and we varied parametrically the level of binaural coherence (BC) of both types of stimuli. Behaviorally, we found that movement discrimination sensitivity decreased with decreasing levels of BC. fMRI analyses highlighted a network of temporal, frontal and parietal regions where activity decreased with decreasing BC. Critically, in the intra-parietal sulcus and the supra-marginal gyrus brain activity decreased with decreasing BC, but only for dynamic-ITD sounds (BC by ITD interaction). Thus, these regions activated selectively when the sounds contained both dynamic ITDs and high levels of BC; i.e. when subjects perceived sound movement. We conclude that sound movement perception requires both dynamic changes of the auditory input and effective sound-source localization, and that parietal cortex utilizes interaural temporal and coherence cues for the successful perception of sound movement.

The origin of adaptation in the auditory pathway of locusts is specific to cell type and function

We investigated the origin of spike frequency adaptation within a layered sensory network: the auditory pathway of locusts. Spike frequency adaptation as observed in an individual neuron may arise because of intrinsic or presynaptic adaptation mechanisms. To separate the contribution of different mechanisms, we recorded from the same cell during acoustic and intracellular current stimulation. We studied three identified neuron types that are representative for each network layer and participate in processing auditory patterns and localizing sound sources. By comparing current and acoustic stimulation, three distinct patterns of the distribution of adaptation mechanisms within the sensory network emerged: (1) balanced influence of both intrinsic and presynaptic adaptation mechanisms in an interneuron that summates over several receptor afferents (TN1), (2) predominantly inhibiting input as the source for spike frequency adaptation in a cell that transmits both pattern representation and directional information (BSN1), (3) primarily intrinsic, spike-triggered adaptation currents within an interneuron coding exclusively for direction (AN2). The time courses of spike frequency adaptation differed significantly between the cells types. Using the adaptation time constants, we were able to predict signal transmission properties for the different cells. We conclude that the adaptation mechanisms differ greatly among interneurons within this sensory pathway and are a function of their role in information processing.

Wide-dynamic-range forward suppression in marmoset inferior colliculus neurons is generated centrally and accounts for perceptual masking

An organism's ability to detect and discriminate sensory inputs depends on the recent stimulus history. For example, perceptual detection thresholds for a brief tone can be elevated by as much as 50 dB when following a masking stimulus. Previous work suggests that such forward masking is not a direct result of peripheral neural adaptation; the central pathway apparently modifies the representation in a way that further attenuates the input's response to short probe signals. Here, we show that much of this transformation is complete by the level of the inferior colliculus (IC). Single-neuron extracellular responses were recorded in the central nucleus of the awake marmoset IC. The threshold for a 20 ms probe tone presented at best frequency was determined for various masker-probe delays, over a range of masker sound pressure levels (SPLs) and frequencies. The most striking aspect of the data was the increased potency of forward maskers as their SPL was increased, despite the fact that the excitatory response to the masker was often saturating or nonmonotonic over the same range of levels. This led to probe thresholds at high masker levels that were almost always higher than those observed in the auditory nerve. Probe threshold shifts were not usually caused by a persistent excitatory response to the masker; instead we propose a wide-dynamic-range inhibitory mechanism locked to sound offset as an explanation for several key aspects of the data. These findings further delineate the role of subcortical auditory processing in the generation of a context-dependent representation of ongoing acoustic scenes.

Transient gain adjustment in the inferior colliculus is serotonin- and calcium-dependent

In the inferior colliculus (IC), a brief period of acoustic conditioning can transiently enhance evoked discharge rate. The cellular basis of this phenomenon was assessed with whole cell current-clamp recordings in a gerbil IC brain slice preparation. The current needed to elicit a single action potential was first established for each neuron. A 5s synaptic stimulus train was delivered to the lateral lemniscus (LL), and followed immediately by the initial current pulse to assess a change in postsynaptic gain. The majority of IC neurons (66%) displayed an increase in current-evoked action potentials (Positive Gain). Despite the blockade of ionotropic glutamate receptors, this effect was correlated with membrane depolarization that occurred during the synaptic train. The postsynaptic mechanism for positive gain was examined by selective blockade of specific neurotransmitter receptors. Gain in action potentials was enhanced by antagonists of metabotropic glutamate, acetylcholine, GABA(A) and glycine receptors. In contrast, the gain was blocked or reduced by an antagonist to ionotropic serotonin receptors (5-HT(3)R). Blocking voltage-activated calcium channels with verapamil also reduced the effect. These results suggest that 5-HT(3)R activation, coupled with increased intracellular calcium, can transiently alter postsynaptic excitability in IC neurons.

Psychophysical and physiological evidence for fast binaural processing

The mammalian auditory system is the temporally most precise sensory modality: To localize low-frequency sounds in space, the binaural system can resolve time differences between the ears with microsecond precision. In contrast, the binaural system appears sluggish in tracking changing interaural time differences as they arise from a low-frequency sound source moving along the horizontal plane. For a combined psychophysical and electrophysiological approach, we created a binaural stimulus, called "Phasewarp," that can transmit rapid changes in interaural timing. Using this stimulus, the binaural performance in humans is significantly better than reported previously and comparable with the monaural performance revealed with amplitude-modulated stimuli. Parallel, electrophysiological recordings of binaural brainstem neurons in the gerbil show fast temporal processing of monaural and different types of binaural modulations. In a refined electrophysiological approach that was matched to the psychophysics, the seemingly faster binaural processing of the Phasewarp was confirmed. The current data provide both psychophysical and physiological evidence against a general, hard-wired binaural sluggishness and reconcile previous contradictions of electrophysiological and psychophysical estimates of temporal binaural performance.

Stimulus-specific adaptations in the gaze control system of the barn owl

Abrupt orientation to novel stimuli is a critical, memory-dependent task performed by the brain. In the present study, we examined two gaze control centers of the barn owl: the optic tectum (OT) and the arcopallium gaze fields (AGFs). Responses of neurons to long sequences of dichotic sound bursts comprised of two sounds differing in the probability of appearance were analyzed. We report that auditory neurons in the OT and in the AGFs tend to respond stronger to rarely presented sounds (novel sounds) than to the same sounds when presented frequently. This history-dependent phenomenon, known as stimulus-specific adaptation (SSA), was demonstrated for rare sound frequencies, binaural localization cues [interaural time difference (ITD) and level difference (ILD)] and sound amplitudes. The manifestation of SSA in such a variety of independent acoustic features, in the midbrain and in the forebrain, supports the notion that SSA is involved in sensory memory and novelty detection. To track the origin of SSA, we analyzed responses of neurons in the external nucleus of the inferior colliculus (ICX; the source of auditory input to the OT) to similar sequences of sound bursts. Neurons in the ICX responded stronger to rare sound frequencies, but did not respond differently to rare ITDs, ILDs, or sound amplitudes. We hypothesize that part of the SSA reported here is computed in high-level networks, giving rise to novelty signals that modulate tectal responses in a context-dependent manner.

Dynamic changes in level influence spatial coding in the lateral superior olive

It is well established that the responses of binaural auditory neurons can adapt and change dramatically depending on the nature of a preceding sound. Examples of how the effects of ensuing stimuli play a functional role in auditory processing include motion sensitivity and precedence-like effects. To date, these types of effects have been documented at the level of the midbrain and above. Little is known about sensitivity to ensuing stimuli below in the superior olivary nuclei where binaural response properties are first established. Here we report on single cell responses in the gerbil lateral superior olive, the initial site where sensitivity to interaural level differences is established. In contrast to our expectations we found a robust sensitivity to ensuing stimuli. The majority of the cells we tested (86%), showed substantial suppression and/or enhancement to a designated target stimulus, depending on the nature of a preceding stimulus. Hence, sensitivity to ensuing stimuli is already established at the first synaptic station of binaural processing.

Sensitivity to interaural time differences in the inferior colliculus with bilateral cochlear implants

Bilateral cochlear implantation attempts to increase performance over a monaural prosthesis by harnessing the binaural processing of the auditory system. Although many bilaterally implanted human subjects discriminate interaural time differences (ITDs), a major cue for sound localization and signal detection in noise, their performance is typically poorer than that of normal-hearing listeners. We developed an animal model of bilateral cochlear implantation to study neural ITD sensitivity for trains of electric current pulses delivered via bilaterally implanted intracochlear electrodes. We found that a majority of single units in the inferior colliculus of acutely deafened, anesthetized cats are sensitive to ITD and that electric ITD tuning is as sharp as found for acoustic stimulation with broadband noise in normal-hearing animals. However, the sharpness and shape of ITD tuning often depended strongly on stimulus intensity; some neurons had dynamic ranges of ITD sensitivity as low as 1 dB. We also found that neural ITD sensitivity was best at pulse rates below 100 Hz and decreased with increasing pulse rate. This rate limitation parallels behavioral ITD discrimination in bilaterally implanted individuals. The sharp neural ITD sensitivity found with electric stimulation at the appropriate intensity is encouraging for the prospect of restoring the functional benefits of binaural hearing in bilaterally implanted human subjects and suggests that neural plasticity resulting from previous deafness and deprivation of binaural experience may play a role in the poor ITD discrimination with current bilateral implants.