Temporal weighting of binaural information at low frequencies: Discrimination of dynamic interaural time and level differences

Factors Influencing Stream Segregation Based on Interaural Phase Difference Cues

Interaural time differences are often considered a weak cue for stream segregation. We investigated this claim with headphone-presented pure tones differing in a related form of interaural configuration-interaural phase differences (ΔIPD)-or/and in frequency (ΔF). In experiment 1, sequences comprised 5 × ABA- repetitions (A and B = 80-ms tones, "-" = 160-ms silence), and listeners reported whether integration or segregation was heard. Envelope shape was varied but remained constant across all tones within a trial. Envelopes were either quasi-trapezoidal or had a fast attack and slow release (FA-SR) or vice versa (SA-FR). The FA-SR envelope caused more segregation than SA-FR in a task where only ΔIPD cues were present, but not in a corresponding ΔF-only task. In experiment 2, interstimulus interval (ISI) was varied (0-60 ms) between FA-SR tones. ΔF-based segregation decreased with increasing ISI, whereas ΔIPD-based segregation increased. This suggests that binaural temporal integration may limit segregation at short ISIs. In another task, ΔF and ΔIPD cues were presented alone or in combination. Here, ΔIPD-based segregation was greatly reduced, suggesting ΔIPD-based segregation is highly sensitive to experimental context. Experiments 1-2 demonstrate that ΔIPD can promote segregation in optimized stimuli/tasks. Experiment 3 employed a task requiring integration for good performance. Listeners detected a delay on the final four B tones of an 8 × ABA- sequence. Although performance worsened with increasing ΔF, increasing ΔIPD had only a marginal impact. This suggests that, even in stimuli optimized for ΔIPD-based segregation, listeners remained mostly able to disregard ΔIPD when segregation was detrimental to performance.

Detection of dynamic changes in interaural delay by older adults (L)

The ability of older adults (48 to 72) with relatively intact low-frequency hearing to detect the motion of an acoustic source was investigated using dynamically varying interaural delays. Thresholds were measured using a single-interval two-alternative forced-choice task in which listeners determined if the sound source was moving or stationary. Motion thresholds were significantly larger than stationary localization thresholds. No correlation was observed between age and motion-detection ability for the age range tested. An interesting finding was that there were similar thresholds for older and younger adults. Results suggest reliance on dominant low-frequency binaural timing cues unaffected by high-frequency hearing loss in older adults.

The influence of envelope shape on the lateralization of amplitude-modulated, low-frequency sound

For abruptly gated sound, interaural time difference (ITD) cues at onset carry greater perceptual weight than those following. This research explored how envelope shape influences such carrier ITD weighting. Experiment 1 assessed the perceived lateralization of a tonal binaural beat that transitioned through ITD (diotic envelope, mean carrier frequency of 500 Hz). Listeners' left/right lateralization judgments were compared to those for static-ITD tones. For an 8 Hz sinusoidally amplitude-modulated envelope, ITD cues 24 ms after onset well-predicted reported sidedness. For an equivalent-duration "abrupt" envelope, which was unmodulated besides 20-ms onset/offset ramps, reported sidedness corresponded to ITDs near onset (e.g., 6 ms). However, unlike for sinusoidal amplitude modulation, ITDs toward offset seemingly also influenced perceived sidedness. Experiment 2 adjusted the duration of the offset ramp (25-75 ms) and found evidence for such offset weighting only for the most abrupt ramp tested. In experiment 3, an ITD was imposed on a brief segment of otherwise diotic filtered noise. Listeners discriminated right- from left-leading ITDs. In sinusoidal amplitude modulation, thresholds were lowest when the ITD segment occurred during rising amplitude. For the abrupt envelope, the lowest thresholds were observed when the segment occurred at either onset or offset. These experiments demonstrate the influence of envelope profile on carrier ITD sensitivity.

Auditory Brainstem Models: Adapting Cochlear Nuclei Improve Spatial Encoding by the Medial Superior Olive in Reverberation

Listeners typically perceive a sound as originating from the direction of its source, even as direct sound is followed milliseconds later by reflected sound from multiple different directions. Early-arriving sound is emphasised in the ascending auditory pathway, including the medial superior olive (MSO) where binaural neurons encode the interaural-time-difference (ITD) cue for spatial location. Perceptually, weighting of ITD conveyed during rising sound energy is stronger at 600 Hz than at 200 Hz, consistent with the minimum stimulus rate for binaural adaptation, and with the longer reverberation times at 600 Hz, compared with 200 Hz, in many natural outdoor environments. Here, we computationally explore the combined efficacy of adaptation prior to the binaural encoding of ITD cues, and excitatory binaural coincidence detection within MSO neurons, in emphasising ITDs conveyed in early-arriving sound. With excitatory inputs from adapting, nonlinear model spherical bushy cells (SBCs) of the bilateral cochlear nuclei, a nonlinear model MSO neuron with low-threshold potassium channels reproduces the rate-dependent emphasis of rising vs. peak sound energy in ITD encoding; adaptation is equally effective in the model MSO. Maintaining adaptation in model SBCs, and adjusting membrane speed in model MSO neurons, 'left' and 'right' populations of computationally efficient, linear model SBCs and MSO neurons reproduce this stronger weighting of ITD conveyed during rising sound energy at 600 Hz compared to 200 Hz. This hemispheric population model demonstrates a link between strong weighting of spatial information during rising sound energy, and correct unambiguous lateralisation of a speech source in reverberation.

Spectro-temporal weighting of interaural time differences in speech

Numerous studies have demonstrated that the perceptual weighting of interaural time differences (ITDs) is non-uniform in time and frequency, leading to reports of spectral and temporal "dominance" regions. It is unclear however, how these dominance regions apply to spectro-temporally complex stimuli such as speech. The authors report spectro-temporal weighting functions for ITDs in a pair of naturally spoken speech tokens ("two" and "eight"). Each speech token was composed of two phonemes, and was partitioned into eight frequency regions over two time bins (one time bin for each phoneme). To derive lateralization weights, ITDs for each time-frequency bin were drawn independently from a normal distribution with a mean of 0 and a standard deviation of 200 μs, and listeners were asked to indicate whether the speech token was presented from the left or right. ITD thresholds were also obtained for each of the 16 time-frequency bins in isolation. The results suggest that spectral dominance regions apply to speech, and that ITDs carried by phonemes in the first position of the syllable contribute more strongly to lateralization judgments than ITDs carried by phonemes in the second position. The results also show that lateralization judgments are partially accounted for by ITD sensitivity across time-frequency bins.

The impact of peripheral mechanisms on the precedence effect

When two similar sounds are presented from different locations, with one (the lead) preceding the other (the lag) by a small delay, listeners typically report hearing one sound near the location of the lead sound source-this is called the precedence effect (PE). Several questions about the underlying mechanisms that produce the PE are asked. (1) How might listeners' relative weighting of cues at onset versus ongoing stimulus portions affect perceived lateral position of long-duration lead/lag noise stimuli? (2) What are the factors that influence this weighting? (3) Are the mechanisms invoked to explain the PE for transient stimuli applicable to long-duration stimuli? To answer these questions, lead/lag noise stimuli are presented with a range of durations, onset slopes, and lag-to-lead level ratios over headphones. Monaural, peripheral mechanisms, and binaural cue extraction are modeled to estimate the cues available for determination of perceived laterality. Results showed that all three stimulus manipulations affect the relative weighting of onset and ongoing cues and that mechanisms invoked to explain the PE for transient stimuli are also applicable to the PE, in terms of both onset and ongoing segments of long-duration, lead/lag stimuli.

Interaction of interaural cues and their contribution to the lateralisation of Mongolian gerbils (Meriones unguiculatus)

The main sound localisation cues in the horizontal plane are interaural time and level differences (ITDs and ILDs, respectively). ITDs are thought to be the dominant cue in the low-frequency range, ILDs the dominant cue in the high-frequency range. ITDs and ILDs co-occur. Their interaction and contribution to the lateralisation of pure tones by Mongolian gerbils was investigated behaviourally using cross-talk cancellation techniques for presenting ITDs and ILDs independently. First, ITDs were applied to pure tones with frequencies ≤ 2 kHz to the ongoing waveform, at the onsets and offsets, or in both the ongoing waveform and at the onsets and offsets. Gerbils could lateralise tones only if ongoing ITDs were present indicating that ongoing ITDs are decisive for the lateralisation of low-frequency tones. Second, an ITD was added to 2-to-6-kHz tones with varying ILD. Gerbils' lateralisation was unaffected by the ITD indicating that a large ILD provides a strong lateralisation cue at those frequencies. Finally, small ILDs were applied to 2-kHz tones with an ongoing ITD, pointing either to the same or opposing sides as the ITD. Gerbils' lateralisation was driven by the ITD but strongly affected by the ILD indicating that both interaural cues contribute to the lateralisation.

Reverberation enhances onset dominance in sound localization

Temporal variation in sensitivity to sound-localization cues was measured in anechoic conditions and in simulated reverberation using the temporal weighting function (TWF) paradigm [Stecker and Hafter (2002). J. Acoust. Soc. Am. 112, 1046-1057]. Listeners judged the locations of Gabor click trains (4 kHz center frequency, 5-ms interclick interval) presented from an array of loudspeakers spanning 360° azimuth. Targets ranged ±56.25° across trials. Individual clicks within each train varied by an additional ±11.25° to allow TWF calculation by multiple regression. In separate conditions, sounds were presented directly or in the presence of simulated reverberation: 13 orders of lateral reflection were computed for a 10 m × 10 m room ( RT60≊300 ms) and mapped to the appropriate locations in the loudspeaker array. Results reveal a marked increase in perceptual weight applied to the initial click in reverberation, along with a reduction in the impact of late-arriving sound. In a second experiment, target stimuli were preceded by trains of "conditioner" sounds with or without reverberation. Effects were modest and limited to the first few clicks in a train, suggesting that impacts of reverberant pre-exposure on localization may be limited to the processing of information from early reflections.

Temporal weighting functions for interaural time and level differences. V. Modulated noise carriers

Sound onsets dominate spatial judgments of many types of periodic sound. Conversely, ongoing cues often dominate in spatial judgments of aperiodic noise. This study quantified onset dominance as a function of both the bandwidth and the temporal regularity of stimuli by measuring temporal weighting functions (TWF) from Stecker, Ostreicher, and Brown [(2013) J. Acoust. Soc. Am. 134, 1242-1252] for lateralization of periodic and aperiodic noise-burst trains. Stimuli consisted of 16 noise bursts (1 ms each) repeating at an interval of 2 or 5 ms. TWFs were calculated by multiple regression of lateralization judgments onto interaural time and level differences, which varied independently ( ±100 μs, ±2 dB) across bursts. Noise tokens were either refreshed on each burst (aperiodic) or repeated across sets of 2, 4, 8, or 16 bursts. TWFs revealed strong onset dominance for periodic noise-burst trains (16 repeats per token), which was markedly reduced in aperiodic trains. A second experiment measured TWFs for periodic but sinusoidally amplitude-modulated noise burst trains, revealing greater weight on the earliest and least intense bursts of the rising envelope slope. The results support the view that envelope fluctuations drive access to binaural information in both periodic and aperiodic sounds.

Tonotopic Variation of the T-Type Ca2+ Current in Avian Auditory Coincidence Detector Neurons

Neurons in avian nucleus laminaris (NL) are binaural coincidence detectors for sound localization and are characterized by striking structural variations in dendrites and axon initial segment (AIS) according to their acoustic tuning [characteristic frequency (CF)]. T-type Ca²⁺ (CaT) channels regulate synaptic integration and firing behavior at these neuronal structures. However, whether or how CaT channels contribute to the signal processing in NL neurons is not known. In this study, we addressed this issue with whole-cell recording and two-photon Ca²⁺ imaging in brain slices of posthatch chicks of both sexes. We found that the CaT current was prominent in low-CF neurons, whereas it was almost absent in higher-CF neurons. In addition, a large Ca²⁺ transient occurred at the dendrites and the AIS of low-CF neurons, indicating a localization of CaT channels at these structures in the neurons. Because low-CF neurons have long dendrites, dendritic CaT channels may compensate for the attenuation of EPSPs at dendrites. Furthermore, the short distance of AIS from the soma may accelerate activation of axonal CaT current in the neurons and help EPSPs reach spike threshold. Indeed, the CaT current was activated by EPSPs and augmented the synaptic response and spike generation of the neurons. Notably, the CaT current was inactivated during repetitive inputs, and these augmenting effects predominated at the initial phase of synaptic activity. These results suggested that dendritic and axonal CaT channels increase the sensitivity to sound at its onset, which may expand the dynamic range for binaural computation in low-CF NL neurons.SIGNIFICANCE STATEMENT Neurons in nucleus laminaris are binaural coincidence detectors for sound localization. We report that T-type Ca²⁺ (CaT) current was prominent at dendrites and the axonal trigger zone in neurons tuned to low-frequency sound. Because these neurons have long dendrites and a closer trigger zone compared with those tuned to higher-frequency sound, the CaT current augmented EPSPs at dendrites and accelerated spike triggers in the neurons, implying a strategic arrangement of the current within the nucleus. This effect was limited to the onset of repetitive inputs due to progressive inactivation of CaT current. The results suggested that the CaT current increases the sensitivity to sound at its onset, which may expand the dynamic range for binaural computation of low-frequency sound.

Sound source localization identification accuracy: Envelope dependencies

Sound source localization accuracy as measured in an identification procedure in a front azimuth sound field was studied for click trains, modulated noises, and a modulated tonal carrier. Sound source localization accuracy was determined as a function of the number of clicks in a 64 Hz click train and click rate for a 500 ms duration click train. The clicks were either broadband or high-pass filtered. Sound source localization accuracy was also measured for a single broadband filtered click and compared to a similar broadband filtered, short-duration noise. Sound source localization accuracy was determined as a function of sinusoidal amplitude modulation and the "transposed" process of modulation of filtered noises and a 4 kHz tone. Different rates (16 to 512 Hz) of modulation (including unmodulated conditions) were used. Providing modulation for filtered click stimuli, filtered noises, and the 4 kHz tone had, at most, a very small effect on sound source localization accuracy. These data suggest that amplitude modulation, while providing information about interaural time differences in headphone studies, does not have much influence on sound source localization accuracy in a sound field.

Strength of onset and ongoing cues in judgments of lateral position

This study describes the contributions to auditory image position of an interaural time delay (ITD) cue at onset relative to subsequent ITDs during the ongoing part of a stimulus. Test stimuli were trains of 1-ms binaural noise bursts; lateral position was measured with a wideband acoustic pointer that subjects adjusted to match the intracranial position of test stimuli. In different conditions the ongoing part of the stimulus (the bursts following the first one) either had a consistent ITD (the same ITD on each ongoing burst), or had alternating leading and lagging components with ITDs that opposed one another. As duration of the ongoing part was increased from 4 to 250 ms, with the initial ITD fixed, lateral position changed from being dominated by the onset ITD to being dominated by the ongoing consistent or leading ITD. With alternating ongoing ITDs equal contributions from onset and ongoing parts were obtained at an ongoing duration of about 40 ms; with consistent ongoing ITDs equal contributions were obtained at about 15 ms. The results point up the increased dominance of onset cues when ongoing cues are ambiguous, as they often are in real-world settings.

Differences in the temporal course of interaural time difference sensitivity between acoustic and electric hearing in amplitude modulated stimuli

Previous studies have shown that normal-hearing (NH) listeners' spatial perception of non-stationary interaural time differences (ITDs) is dominated by the carrier ITD during rising amplitude segments. Here, ITD sensitivity throughout the amplitude-modulation cycle in NH listeners and bilateral cochlear implant (CI) subjects is compared, the latter by means of direct stimulation of a single electrode pair. The data indicate that, while NH listeners are most sensitive to ITDs applied toward the beginning of a modulation cycle at 600 Hz, NH listeners at 200 Hz and especially bilateral CI subjects at 200 pulses per second (pps) are more sensitive to ITDs applied to the modulation maximum. This has implications for spatial-hearing in complex environments: NH listeners' dominant 600-Hz ITD information from the rising amplitude segments comprises direct sound information. The 200-pps low rate required to get ITD sensitivity in CI users results in a higher weight of pulses later in the modulation cycle where the source ITDs are more likely corrupted by reflections. This indirectly indicates that even if future binaural CI processors are able to provide perceptually exploitable ITD information, CI users will likely not get the full benefit from such pulse-based ITD cues in reverberant and other complex environments.

Spectrotemporal weighting of binaural cues: Effects of a diotic interferer on discrimination of dynamic interaural differences

Spatial judgments are often dominated by low-frequency binaural cues and onset cues when binaural cues vary across the spectrum and duration, respectively, of a brief sound. This study combined these dimensions to assess the spectrotemporal weighting of binaural information. Listeners discriminated target interaural time difference (ITD) and interaural level difference (ILD) carried by the onset, offset, or full duration of a 4-kHz Gabor click train with a 2-ms period in the presence or absence of a diotic 500-Hz interferer tone. ITD and ILD thresholds were significantly elevated by the interferer in all conditions and by a similar amount to previous reports for static cues. Binaural interference was dramatically greater for ITD targets lacking onset cues compared to onset and full-duration conditions. Binaural interference for ILD targets was similar across dynamic-cue conditions. These effects mirror the baseline discriminability of dynamic ITD and ILD cues [Stecker and Brown. (2010). J. Acoust. Soc. Am. 127, 3092-3103], consistent with stronger interference for less-robust/higher-variance cues. The results support the view that binaural cue integration occurs simultaneously across multiple variance-weighted dimensions, including time and frequency.

The precedence effect with increased lag level

When a pair of sounds arrive from different directions with a sufficiently short delay between them, listeners hear a perceptually fused image with a perceived location that is dominated by the first arriving sound. This is called the precedence effect. To test the limits of this phenomenon, 200-ms noise stimuli were presented over headphones to model a temporally overlapping direct sound (lead) with a single reflection (lag) at inter-stimulus intervals (ISIs) of 0-5 ms. Lag intensity exceeded that of the lead by 0-10 dB. Results for 16 listeners show that lateralization shifted from the position of the lead towards the lag as lag level increased. Response variability also increased with lag level. An oscillatory pattern emerged across ISIs as lag level increased, to a degree that varied greatly between listeners. Analysis of modeled binaural cues suggests that these oscillatory patterns are correlated with ILDs produced by the physical interference of lead and lag during the ongoing portion of the stimulus, especially in the 764-Hz frequency band. Different listeners apparently weighted cues from the onset versus ongoing portions of the stimulus differently, as evidenced by the varying degree of influence the ongoing ILD cues had on listeners' perceived lateralization.