Differences in the temporal course of interaural time difference sensitivity between acoustic and electric hearing in amplitude modulated stimuli

Rate dependent neural responses of interaural-time-difference cues in fine-structure and envelope

Advancements in cochlear implants (CIs) have led to a significant increase in bilateral CI users, especially among children. Yet, most bilateral CI users do not fully achieve the intended binaural benefit due to potential limitations in signal processing and/or surgical implant positioning. One crucial auditory cue that normal hearing (NH) listeners can benefit from is the interaural time difference (ITD), i.e., the time difference between the arrival of a sound at two ears. The ITD sensitivity is thought to be heavily relying on the effective utilization of temporal fine structure (very rapid oscillations in sound). Unfortunately, most current CIs do not transmit such true fine structure. Nevertheless, bilateral CI users have demonstrated sensitivity to ITD cues delivered through envelope or interaural pulse time differences, i.e., the time gap between the pulses delivered to the two implants. However, their ITD sensitivity is significantly poorer compared to NH individuals, and it further degrades at higher CI stimulation rates, especially when the rate exceeds 300 pulse per second. The overall purpose of this research thread is to improve spatial hearing abilities in bilateral CI users. This study aims to develop electroencephalography (EEG) paradigms that can be used with clinical settings to assess and optimize the delivery of ITD cues, which are crucial for spatial hearing in everyday life. The research objective of this article was to determine the effect of CI stimulation pulse rate on the ITD sensitivity, and to characterize the rate-dependent degradation in ITD perception using EEG measures. To develop protocols for bilateral CI studies, EEG responses were obtained from NH listeners using sinusoidal-amplitude-modulated (SAM) tones and filtered clicks with changes in either fine structure ITD (ITDFS) or envelope ITD (ITDENV). Multiple EEG responses were analyzed, which included the subcortical auditory steady-state responses (ASSRs) and cortical auditory evoked potentials (CAEPs) elicited by stimuli onset, offset, and changes. Results indicated that acoustic change complex (ACC) responses elicited by ITDENV changes were significantly smaller or absent compared to those elicited by ITDFS changes. The ACC morphologies evoked by ITDFS changes were similar to onset and offset CAEPs, although the peak latencies were longest for ACC responses and shortest for offset CAEPs. The high-frequency stimuli clearly elicited subcortical ASSRs, but smaller than those evoked by lower carrier frequency SAM tones. The 40-Hz ASSRs decreased with increasing carrier frequencies. Filtered clicks elicited larger ASSRs compared to high-frequency SAM tones, with the order being 40 > 160 > 80> 320 Hz ASSR for both stimulus types. Wavelet analysis revealed a clear interaction between detectable transient CAEPs and 40-Hz ASSRs in the time-frequency domain for SAM tones with a low carrier frequency.

Factors Influencing Stream Segregation Based on Interaural Phase Difference Cues

Interaural time differences are often considered a weak cue for stream segregation. We investigated this claim with headphone-presented pure tones differing in a related form of interaural configuration-interaural phase differences (ΔIPD)-or/and in frequency (ΔF). In experiment 1, sequences comprised 5 × ABA- repetitions (A and B = 80-ms tones, "-" = 160-ms silence), and listeners reported whether integration or segregation was heard. Envelope shape was varied but remained constant across all tones within a trial. Envelopes were either quasi-trapezoidal or had a fast attack and slow release (FA-SR) or vice versa (SA-FR). The FA-SR envelope caused more segregation than SA-FR in a task where only ΔIPD cues were present, but not in a corresponding ΔF-only task. In experiment 2, interstimulus interval (ISI) was varied (0-60 ms) between FA-SR tones. ΔF-based segregation decreased with increasing ISI, whereas ΔIPD-based segregation increased. This suggests that binaural temporal integration may limit segregation at short ISIs. In another task, ΔF and ΔIPD cues were presented alone or in combination. Here, ΔIPD-based segregation was greatly reduced, suggesting ΔIPD-based segregation is highly sensitive to experimental context. Experiments 1-2 demonstrate that ΔIPD can promote segregation in optimized stimuli/tasks. Experiment 3 employed a task requiring integration for good performance. Listeners detected a delay on the final four B tones of an 8 × ABA- sequence. Although performance worsened with increasing ΔF, increasing ΔIPD had only a marginal impact. This suggests that, even in stimuli optimized for ΔIPD-based segregation, listeners remained mostly able to disregard ΔIPD when segregation was detrimental to performance.

Effects of better-ear glimpsing, binaural unmasking, and spectral resolution on spatial release from masking in cochlear-implant users

Bilateral cochlear-implant (BICI) listeners obtain less spatial release from masking (SRM; speech-recognition improvement for spatially separated vs co-located conditions) than normal-hearing (NH) listeners, especially for symmetrically placed maskers that produce similar long-term target-to-masker ratios at the two ears. Two experiments examined possible causes of this deficit, including limited better-ear glimpsing (using speech information from the more advantageous ear in each time-frequency unit), limited binaural unmasking (using interaural differences to improve signal-in-noise detection), or limited spectral resolution. Listeners had NH (presented with unprocessed or vocoded stimuli) or BICIs. Experiment 1 compared natural symmetric maskers, idealized monaural better-ear masker (IMBM) stimuli that automatically performed better-ear glimpsing, and hybrid stimuli that added worse-ear information, potentially restoring binaural cues. BICI and NH-vocoded SRM was comparable to NH-unprocessed SRM for idealized stimuli but was 14%-22% lower for symmetric stimuli, suggesting limited better-ear glimpsing ability. Hybrid stimuli improved SRM for NH-unprocessed listeners but degraded SRM for BICI and NH-vocoded listeners, suggesting they experienced across-ear interference instead of binaural unmasking. In experiment 2, increasing the number of vocoder channels did not change NH-vocoded SRM. BICI SRM deficits likely reflect a combination of across-ear interference, limited better-ear glimpsing, and poorer binaural unmasking that stems from cochlear-implant-processing limitations other than reduced spectral resolution.

A Modelling Study on the Comparison of Predicted Auditory Nerve Firing Rates for the Personalized Indication of Cochlear Implantation

The decision of whether to perform cochlear implantation is crucial because implantation cannot be reversed without harm. The aim of the study was to compare model-predicted time–place representations of auditory nerve (AN) firing rates for normal hearing and impaired hearing with a view towards personalized indication of cochlear implantation. AN firing rates of 1024 virtual subjects with a wide variety of different types and degrees of hearing impairment were predicted. A normal hearing reference was compared to four hearing prosthesis options, which were unaided hearing, sole acoustic amplification, sole electrical stimulation, and a combination of the latter two. The comparisons and the fitting of the prostheses were based on a ‘loss of action potentials’ (LAP) score. Single-parameter threshold analysis suggested that cochlear implantation is indicated when more than approximately two-thirds of the inner hair cells (IHCs) are damaged. Second, cochlear implantation is also indicated when more than an average of approximately 12 synapses per IHC are damaged due to cochlear synaptopathy (CS). Cochlear gain loss (CGL) appeared to shift these thresholds only slightly. Finally, a support vector machine predicted the indication of a cochlear implantation from hearing loss parameters with a 10-fold cross-validated accuracy of 99.2%.

Modulation Depth Discrimination by Cochlear Implant Users

Cochlear implants (CIs) convey the amplitude envelope of speech by modulating high-rate pulse trains. However, not all of the envelope may be necessary to perceive amplitude modulations (AMs); the effective envelope depth may be limited by forward and backward masking from the envelope peaks. Three experiments used modulated pulse trains to measure which portions of the envelope can be effectively processed by CI users as a function of AM frequency. Experiment 1 used a three-interval forced-choice task to test the ability of CI users to discriminate less-modulated pulse trains from a fully modulated standard, without controlling for loudness. The stimuli in experiment 2 were identical, but a two-interval task was used in which participants were required to choose the less-modulated interval, ignoring loudness. Catch trials, in which judgements based on level or modulation depth would give opposing answers, were included. Experiment 3 employed novel stimuli whose modulation envelope could be modified below a variable point in the dynamic range, without changing the loudness of the stimulus. Overall, results showed that substantial portions of the envelope are not accurately encoded by CI users. In experiment 1, where loudness cues were available, participants on average were insensitive to changes in the bottom 30% of their dynamic range. In experiment 2, where loudness was controlled, participants appeared insensitive to changes in the bottom 50% of the dynamic range. In experiment 3, participants were insensitive to changes in the bottom 80% of the dynamic range. We discuss potential reasons for this insensitivity and implications for CI speech-processing strategies.

Simulation of ITD-Dependent Single-Neuron Responses Under Electrical Stimulation and with Amplitude-Modulated Acoustic Stimuli

Interaural time difference (ITD) sensitivity with cochlear implant stimulation is remarkably similar to envelope ITD sensitivity using conventional acoustic stimulation. This holds true for human perception, as well as for neural response rates recorded in the inferior colliculus of several mammalian species. We hypothesize that robust excitatory-inhibitory (EI) interaction is the dominant mechanism. Therefore, we connected the same single EI-model neuron to either a model of the normal acoustic auditory periphery or to a model of the electrically stimulated auditory nerve. The model captured most features of the experimentally obtained response properties with electric stimulation, such as the shape of rate-ITD functions, the dependence on stimulation level, and the pulse rate or modulation-frequency dependence. Rate-ITD functions with high-rate, amplitude-modulated electric stimuli were very similar to their acoustic counterparts. Responses obtained with unmodulated electric pulse trains most resembled acoustic filtered clicks. The fairly rapid decline of ITD sensitivity at rates above 300 pulses or cycles per second is correctly simulated by the 3.1-ms time constant of the inhibitory post-synaptic conductance. As the model accounts for these basic properties, it is expected to help in understanding and quantifying the binaural hearing abilities with electric stimulation when integrated in bigger simulation frameworks.

High-resolution temporal weighting of interaural time differences in speech

Previous studies have shown that for high-rate click trains and low-frequency pure tones, interaural time differences (ITDs) at the onset of stimulus contribute most strongly to the overall lateralization percept (receive the largest perceptual weight). Previous studies have also shown that when these stimuli are modulated, ITDs during the rising portion of the modulation cycle receive increased perceptual weight. Baltzell, Cho, Swaminathan, and Best [(2020). J. Acoust. Soc. Am. 147, 3883-3894] measured perceptual weights for a pair of spoken words ("two" and "eight"), and found that word-initial phonemes receive larger weight than word-final phonemes, suggesting a "word-onset dominance" for speech. Generalizability of this conclusion was limited by a coarse temporal resolution and limited stimulus set. In the present study, temporal weighting functions (TWFs) were measured for four spoken words ("two," "eight," "six," and "nine"). Stimuli were partitioned into 30-ms bins, ITDs were applied independently to each bin, and lateralization judgements were obtained. TWFs were derived using a hierarchical regression model. Results suggest that "word-initial" onset dominance does not generalize across words and that TWFs depend in part on acoustic changes throughout the stimulus. Two model-based predictions were generated to account for observed TWFs, but neither could fully account for the perceptual data.

The influence of envelope shape on the lateralization of amplitude-modulated, low-frequency sound

For abruptly gated sound, interaural time difference (ITD) cues at onset carry greater perceptual weight than those following. This research explored how envelope shape influences such carrier ITD weighting. Experiment 1 assessed the perceived lateralization of a tonal binaural beat that transitioned through ITD (diotic envelope, mean carrier frequency of 500 Hz). Listeners' left/right lateralization judgments were compared to those for static-ITD tones. For an 8 Hz sinusoidally amplitude-modulated envelope, ITD cues 24 ms after onset well-predicted reported sidedness. For an equivalent-duration "abrupt" envelope, which was unmodulated besides 20-ms onset/offset ramps, reported sidedness corresponded to ITDs near onset (e.g., 6 ms). However, unlike for sinusoidal amplitude modulation, ITDs toward offset seemingly also influenced perceived sidedness. Experiment 2 adjusted the duration of the offset ramp (25-75 ms) and found evidence for such offset weighting only for the most abrupt ramp tested. In experiment 3, an ITD was imposed on a brief segment of otherwise diotic filtered noise. Listeners discriminated right- from left-leading ITDs. In sinusoidal amplitude modulation, thresholds were lowest when the ITD segment occurred during rising amplitude. For the abrupt envelope, the lowest thresholds were observed when the segment occurred at either onset or offset. These experiments demonstrate the influence of envelope profile on carrier ITD sensitivity.

Auditory Brainstem Models: Adapting Cochlear Nuclei Improve Spatial Encoding by the Medial Superior Olive in Reverberation

Listeners typically perceive a sound as originating from the direction of its source, even as direct sound is followed milliseconds later by reflected sound from multiple different directions. Early-arriving sound is emphasised in the ascending auditory pathway, including the medial superior olive (MSO) where binaural neurons encode the interaural-time-difference (ITD) cue for spatial location. Perceptually, weighting of ITD conveyed during rising sound energy is stronger at 600 Hz than at 200 Hz, consistent with the minimum stimulus rate for binaural adaptation, and with the longer reverberation times at 600 Hz, compared with 200 Hz, in many natural outdoor environments. Here, we computationally explore the combined efficacy of adaptation prior to the binaural encoding of ITD cues, and excitatory binaural coincidence detection within MSO neurons, in emphasising ITDs conveyed in early-arriving sound. With excitatory inputs from adapting, nonlinear model spherical bushy cells (SBCs) of the bilateral cochlear nuclei, a nonlinear model MSO neuron with low-threshold potassium channels reproduces the rate-dependent emphasis of rising vs. peak sound energy in ITD encoding; adaptation is equally effective in the model MSO. Maintaining adaptation in model SBCs, and adjusting membrane speed in model MSO neurons, 'left' and 'right' populations of computationally efficient, linear model SBCs and MSO neurons reproduce this stronger weighting of ITD conveyed during rising sound energy at 600 Hz compared to 200 Hz. This hemispheric population model demonstrates a link between strong weighting of spatial information during rising sound energy, and correct unambiguous lateralisation of a speech source in reverberation.

Estimating the perceptual weighting of interaural time difference cues in amplitude modulated binaural beats

For an abruptly gated sound, perceived lateralization is determined primarily by binaural cues at onset. Relatively less is known about the temporal weighing of binaural cues-such as interaural time difference (ITD)-during more naturalistic modulation profiles. Here, an experiment measured the lateralization of a tonal binaural beat modulated by a diotic, 8-Hz sinusoidal amplitude modulation. Binaural beat lateralization (left/right, two alternatives) was compared to that for tones with static ITDs. Across three mean carrier frequencies (200, 500, and 800 Hz), ITDs occurring during early rising amplitude (e.g., 20-25 ms after onset) predicted the perceived lateralization of the binaural beat signals well.

Evaluating the Impact of Age, Acoustic Exposure, and Electrical Stimulation on Binaural Sensitivity in Adult Bilateral Cochlear Implant Patients

Deafness in both ears is highly disruptive to communication in everyday listening situations. Many individuals with profound deafness receive bilateral cochlear implants (CIs) to gain access to spatial cues used in localization and speech understanding in noise. However, the benefit of bilateral CIs, in particular sensitivity to interaural time and level differences (ITD and ILDs), varies among patients. We measured binaural sensitivity in 46 adult bilateral CI patients to explore the relationship between binaural sensitivity and three classes of patient-related factors: age, acoustic exposure, and electric hearing experience. Results show that ILD sensitivity increased with shorter years of acoustic exposure, younger age at testing, or an interaction between these factors, moderated by the duration of bilateral hearing impairment. ITD sensitivity was impacted by a moderating effect between years of bilateral hearing impairment and CI experience. When age at onset of deafness was treated as two categories (<18 vs. >18 years of age), there was no clear effect for ILD sensitivity, but some differences were observed for ITD sensitivity. Our findings imply that maximal binaural sensitivity is obtained by listeners with a shorter bilateral hearing impairment, a longer duration of CI experience, and potentially a younger age at testing. 198/200.

Spectro-temporal weighting of interaural time differences in speech

Numerous studies have demonstrated that the perceptual weighting of interaural time differences (ITDs) is non-uniform in time and frequency, leading to reports of spectral and temporal "dominance" regions. It is unclear however, how these dominance regions apply to spectro-temporally complex stimuli such as speech. The authors report spectro-temporal weighting functions for ITDs in a pair of naturally spoken speech tokens ("two" and "eight"). Each speech token was composed of two phonemes, and was partitioned into eight frequency regions over two time bins (one time bin for each phoneme). To derive lateralization weights, ITDs for each time-frequency bin were drawn independently from a normal distribution with a mean of 0 and a standard deviation of 200 μs, and listeners were asked to indicate whether the speech token was presented from the left or right. ITD thresholds were also obtained for each of the 16 time-frequency bins in isolation. The results suggest that spectral dominance regions apply to speech, and that ITDs carried by phonemes in the first position of the syllable contribute more strongly to lateralization judgments than ITDs carried by phonemes in the second position. The results also show that lateralization judgments are partially accounted for by ITD sensitivity across time-frequency bins.

Binaural sensitivity and release from speech-on-speech masking in listeners with and without hearing loss

Listeners with sensorineural hearing loss routinely experience less spatial release from masking (SRM) in speech mixtures than listeners with normal hearing. Hearing-impaired listeners have also been shown to have degraded temporal fine structure (TFS) sensitivity, a consequence of which is degraded access to interaural time differences (ITDs) contained in the TFS. Since these "binaural TFS" cues are critical for spatial hearing, it has been hypothesized that degraded binaural TFS sensitivity accounts for the limited SRM experienced by hearing-impaired listeners. In this study, speech stimuli were noise-vocoded using carriers that were systematically decorrelated across the left and right ears, thus simulating degraded binaural TFS sensitivity. Both (1) ITD sensitivity in quiet and (2) SRM in speech mixtures spatialized using ITDs (or binaural release from masking; BRM) were measured as a function of TFS interaural decorrelation in young normal-hearing and hearing-impaired listeners. This allowed for the examination of the relationship between ITD sensitivity and BRM over a wide range of ITD thresholds. This paper found that, for a given ITD sensitivity, hearing-impaired listeners experienced less BRM than normal-hearing listeners, suggesting that binaural TFS sensitivity can account for only a modest portion of the BRM deficit in hearing-impaired listeners. However, substantial individual variability was observed.

Improving Interaural Time Difference Sensitivity Using Short Inter-pulse Intervals with Amplitude-Modulated Pulse Trains in Bilateral Cochlear Implants

Interaural time differences (ITDs) at low frequencies are important for sound localization and spatial speech unmasking. These ITD cues are not encoded in commonly used envelope-based stimulation strategies for cochlear implants (CIs) using high pulse rates. However, ITD sensitivity can be improved by adding extra pulses with short inter-pulse intervals (SIPIs) in unmodulated high-rate trains. Here, we investigated whether this improvement also applies to amplitude-modulated (AM) high-rate pulse trains. To this end, we systematically varied the temporal position of SIPI pulses within the envelope cycle (SIPI phase), the fundamental frequency (F0) of AM (125 Hz and 250 Hz), and AM depth (from 0.1 to 0.9). Stimuli were presented at an interaurally place-matched electrode pair at a reference pulse rate of 1000 pulses/s. Participants performed an ITD-based left/right discrimination task. SIPI insertion resulted in improved ITD sensitivity throughout the range of modulation depths and for both male and female F0s. The improvements were largest for insertion at and around the envelope peak. These results are promising for conveying salient ITD cues at high pulse rates commonly used to encode speech information.

Temporal-pitch sensitivity in electric hearing with amplitude modulation and inserted pulses with short inter-pulse intervals

Listeners with cochlear implants (CIs) typically show poor sensitivity to the temporal-envelope pitch of high-rate pulse trains. Sensitivity to interaural time differences improves when adding pulses with short inter-pulse intervals (SIPIs) to high-rate pulse trains. In the current study, monaural temporal-pitch sensitivity with SIPI pulses was investigated for six CI listeners. Amplitude-modulated single-electrode stimuli, representing the coding of the fundamental frequency (F0) in the envelope of a high-rate carrier, were used. Two SIPI-insertion approaches, five modulation depths, two typical speech-F0s, and two carrier rates were tested. SIPI pulses were inserted either in every amplitude-modulation period (full-rate SIPI) to support the F0 cue or in every other amplitude-modulation period (half-rate SIPI) to circumvent a potential rate limitation at higher F0s. The results demonstrate that full-rate SIPI pulses improve temporal-pitch sensitivity across F0s and particularly at low modulation depths where envelope-pitch cues are weak. The half-rate SIPI pulses did not circumvent the limitation and further increased variability across listeners. Further, no effect of the carrier rate was found. Thus, the SIPI approach appears to be a promising approach to enhance CI listeners' access to temporal-envelope pitch cues at pulse rates used clinically.

The effect of envelope modulations on binaural processing

An experiment was performed with 10 young normal-hearing listeners that attempted to determine if envelope modulations affected binaural processing in bandlimited pulse trains. Listeners detected an interaurally out-of-phase carrier pulse train in the presence of different amplitude modulations. The peaks of the pulses were constant (called "flat" or F), followed envelope modulations from an interaurally correlated 50-Hz bandwidth noise (called CM), or followed modulations from an interaurally uncorrelated noise (called UM). The pulse rate was varied from 50 to 500 pulses per second (pps) and the center frequency (CF) was 4 or 8 kHz. It was hypothesized that CM would cause no change or an increase in performance compared to F; UM would cause a decrease because of the blurring of the binaural detection cue. There was a small but significant decrease from F to CM (inconsistent with the hypothesis) and a further decrease from CM to UM (consistent with the hypothesis). Critically, there was a significant envelope by rate interaction caused by a decrease from F to CM for the 200-300 pps rates. The data can be explained by a subject-based factor, where some listeners experienced interaural envelope decorrelation when the sound was encoded by the auditory system that reduced performance when the modulations were present. Since the decrease in performance between F and CM conditions was small, it seems that most young normal-hearing listeners have very similar encoding of modulated stimuli across the ears. This type of task, when further optimized, may be able to assess if hearing-impaired populations experience interaural decorrelation from encoding modulated stimuli and therefore could help better understand the limited spatial hearing in populations like cochlear-implant users.

Binaural interference with simulated electric acoustic stimulation

Preserved low-frequency acoustic hearing in cochlear implant (CI) recipients affords combined electric-acoustic stimulation (EAS) that could improve access to low-frequency acoustic binaural cues and enhance spatial hearing. Such benefits, however, could be undermined by interactions between electrical and acoustical inputs to adjacent (spectral overlap) or distant (binaural interference) cochlear places in EAS. This study simulated EAS in normal-hearing listeners, measuring interaural time difference (ITD) and interaural level difference (ILD) discrimination thresholds for a low-frequency noise (simulated acoustic target) in the presence or absence of a pulsatile high-frequency complex presented monotically or diotically (simulated unilateral or bilateral electric distractor). Unilateral distractors impaired thresholds for both cue types, suggesting influences of both binaural interference (which appeared more consistently for ITD than ILD) and physical spectral overlap (for both cue types). Reducing spectral overlap with an EAS gap between 1 and 3 kHz consistently improved binaural sensitivity. Finally, listeners displayed significantly lower thresholds with simulated bilateral versus unilateral electric stimulation. The combined effects revealed similar or better thresholds in bilateral full spectral overlap than in unilateral EAS gap conditions, suggesting that bilateral implantation with bilateral acoustic hearing preservation could allow for higher tolerance of spectral overlap in CI users and improved binaural sensitivity over unilateral EAS.

Localization of broadband sounds carrying interaural time differences: Effects of frequency, reference location, and interaural coherence

The auditory processes involved in the localization of sounds in rooms are still poorly understood. The present study investigated the auditory system's across-frequency processing of interaural time differences (ITDs) and the impact of the interaural coherence (IC) of the stimuli in ITD discrimination and localization. First, ITD discrimination thresholds were measured as a function of signal frequency, reference ITD, and IC using critical-band wide noises. The resulting data were fitted with a set of analytical functions and ITD weights were derived using concepts from signal detection theory. Inspired by the weighted-image model [Stern, Zeiberg, and Trahiotis. (1988). J. Acoust. Soc. Am. 84, 156-165], the derived ITD weights were then integrated in a simplified localization model using an optimal combination of ITD information across frequency. To verify this model, a series of localization experiments were conducted using broadband noise in which ITD and IC were varied across frequency. The model predictions were in good agreement with the experimental data, supporting the assumption that the auditory system performs a weighted integration of ITD information across frequency to localize a sound source. The results could be valuable for the design of new paradigms to measure localization in more complex acoustic conditions and may provide constraints for future localization models.

Better-ear glimpsing with symmetrically-placed interferers in bilateral cochlear implant users

For a frontal target in spatially symmetrically placed interferers, normal hearing (NH) listeners can use "better-ear glimpsing" to select time-frequency segments with favorable signal-to-noise ratio in either ear. With an ideal monaural better-ear mask (IMBM) processing, some studies showed that NH listeners can reach similar performance as in the natural binaural listening condition, although interaural phase differences at low frequencies can further improve performance. In principle, bilateral cochlear implant (BiCI) listeners could use the same better-ear glimpsing, albeit without exploiting interaural phase differences. Speech reception thresholds of NH and BiCI listeners were measured in three interferers (speech-shaped stationary noise, nonsense speech, or single talker) either co-located with the target, symmetrically placed at ±60°, or independently presented to each ear, with and without IMBM processing. Furthermore, a bilateral noise vocoder based on the BiCI electrodogram was used in the same NH listeners. Headphone presentation and direct stimulation with head-related transfer functions for spatialization were used in NH and BiCI listeners, respectively. Compared to NH listeners, both NH listeners with vocoder and BiCI listeners showed strongly reduced binaural benefit from spatial separation. However, both groups greatly benefited from IMBM processing as part of the stimulation strategy.

Mixed stimulation rates to improve sensitivity of interaural timing differences in bilateral cochlear implant listeners

Normal hearing listeners extract small interaural time differences (ITDs) and interaural level differences (ILDs) to locate sounds and segregate targets from noise. Bilateral cochlear implant listeners show poor sensitivity to ITDs when using clinical processors. This is because common clinical stimulation approaches use high rates [∼1000 pulses per-second (pps)] for each electrode in order to provide good speech representation, but sensitivity to ITDs is best at low rates of stimulation (∼100-300 pps). Mixing rates of stimulation across the array is a potential solution. Here, ITD sensitivity for a number of mixed-rate configurations that were designed to preserve speech envelope cues using high-rate stimulation and spatial hearing using low rate stimulation was examined. Results showed that ITD sensitivity in mixed-rate configurations when only one low rate electrode was included generally yielded ITD thresholds comparable to a configuration with low rates only. Low rate stimulation at basal or middle regions on the electrode array yielded the best sensitivity to ITDs. This work provides critical evidence that supports the use of mixed-rate strategies for improving ITD sensitivity in bilateral cochlear implant users.

Temporal weighting functions for interaural time and level differences. V. Modulated noise carriers

Sound onsets dominate spatial judgments of many types of periodic sound. Conversely, ongoing cues often dominate in spatial judgments of aperiodic noise. This study quantified onset dominance as a function of both the bandwidth and the temporal regularity of stimuli by measuring temporal weighting functions (TWF) from Stecker, Ostreicher, and Brown [(2013) J. Acoust. Soc. Am. 134, 1242-1252] for lateralization of periodic and aperiodic noise-burst trains. Stimuli consisted of 16 noise bursts (1 ms each) repeating at an interval of 2 or 5 ms. TWFs were calculated by multiple regression of lateralization judgments onto interaural time and level differences, which varied independently ( ±100 μs, ±2 dB) across bursts. Noise tokens were either refreshed on each burst (aperiodic) or repeated across sets of 2, 4, 8, or 16 bursts. TWFs revealed strong onset dominance for periodic noise-burst trains (16 repeats per token), which was markedly reduced in aperiodic trains. A second experiment measured TWFs for periodic but sinusoidally amplitude-modulated noise burst trains, revealing greater weight on the earliest and least intense bursts of the rising envelope slope. The results support the view that envelope fluctuations drive access to binaural information in both periodic and aperiodic sounds.

Temporal effects in interaural and sequential level difference perception

Temporal effects in interaural level difference (ILD) perception are not well understood. While it is often assumed that ILD sensitivity is independent of the temporal stimulus properties, a reduction of ILD sensitivity for stimuli with a high modulation rate has been reported (known under the term binaural adaptation). Experiment 1 compared ILD thresholds and sequential-level-difference (SLD) thresholds using 300-ms bandpass-filtered pulse trains (centered at 4 kHz) with rates of 100, 400, and 800 pulses per second (pps). In contrast to the SLD thresholds, ILD thresholds were elevated at 800 pps, consistent with literature data that had previously been attributed to binaural adaptation. Experiment 2 showed better ILD sensitivity for pulse trains than for pure tones, suggesting that amplitude modulation enhances ILD sensitivity. The present ILD data and binaural adaptation data from the literature were predicted by a model combining well-established auditory periphery front-ends with an interaural comparison stage. The model also accounted for other published ILD data, including target ILD thresholds in diotic forward and backward fringes and ILD thresholds with different amounts of interaural correlation. Overall, a variety of temporal effects in ILD perception, including binaural adaptation, appear to be largely attributable to monaural peripheral auditory processing.

Temporal Envelope Coding by Inferior Colliculus Neurons with Cochlear Implant Stimulation

Modulations in temporal envelopes are a ubiquitous property of natural sounds and are especially important for hearing with cochlear implants (CIs) because these devices typically discard temporal fine structure information. With few exceptions, neural temporal envelope processing has been studied in both normal hearing (NH) and CI animals using only pure sinusoidal amplitude modulation (SAM) which poorly represents the diversity of envelope shapes contained in natural sounds because it confounds repetition rate and the width of each modulation cycle. Here, we used stimuli that allow independent manipulation of the two parameters to characterize envelope processing by inferior colliculus (IC) neurons in barbiturate-anesthetized cats with CIs. Specifically, the stimuli were amplitude modulated, high rate pulse trains, where the envelope waveform interleaved single cycles ("bursts") of a sinusoid with silent intervals. We found that IC neurons vary widely with respect to the envelope parameters that maximize their firing rates. In general, pure SAM was a relatively ineffective stimulus. The majority of neurons (60 %) preferred a combination of short bursts and low repetition rates (long silent intervals). Others preferred low repetition rates with minimal dependence on envelope width (17 %), while the remainder responded most strongly to brief bursts with lesser sensitivity to repetition rate (23 %). A simple phenomenological model suggests that a combination of inhibitory and intrinsic cellular mechanisms suffices to account for the wide variation in optimal envelope shapes. In contrast to the strong dependence of firing rate on envelope shape, neurons tended to phase lock precisely to the envelope regardless of shape. Most neurons tended to fire specifically near the peak of the modulation cycle, with little phase dispersion within or across neurons. Such consistently precise timing degrades envelope coding compared to NH processing of real-world sounds, because it effectively eliminates spike timing as a cue to envelope shape.

Extent of lateralization at large interaural time differences in simulated electric hearing and bilateral cochlear implant users

Normal-hearing (NH) listeners are able to localize sound sources with extraordinary accuracy through interaural cues, most importantly interaural time differences (ITDs) in the temporal fine structure. Bilateral cochlear implant (CI) users are also able to localize sound sources, yet generally at lower accuracy than NH listeners. The gap in performance can in part be attributed to current CI systems not faithfully transmitting interaural cues, especially ITDs. With the introduction of binaurally linked CI systems, the presentation of ITD cues for bilateral CI users is foreseeable. The current study therefore investigated extent-of-lateralization percepts elicited in bilateral CI listeners when presented with single-electrode pulse-trains carrying controlled ITD cues. The results were compared against NH listeners listening to broadband stimuli as well as simulations of CI listening. Broadband stimuli in NH listeners were perceived as fully lateralized within the natural ITD range. Using simulated as well as real CI stimuli, however, only a fraction of the full extent of lateralization range was covered by natural ITDs. The maximum extent of lateralization was reached at ITDs as large as twice the natural limit. The results suggest that ITD-enhancement might be a viable option for improving localization abilities with future binaural CI systems.