Discrimination of temporal asymmetry in cochlear implantees

Perception of stochastic envelopes by normal-hearing and cochlear-implant listeners

We assessed auditory sensitivity to three classes of temporal-envelope statistics (modulation depth, modulation rate, and comodulation) that are important for the perception of 'sound textures'. The textures were generated by a probabilistic model that prescribes the temporal statistics of a selected number of modulation envelopes, superimposed onto noise carriers. Discrimination thresholds were measured for normal-hearing (NH) listeners and users of a MED-EL pulsar cochlear implant (CI), for separate manipulations of the average rate and modulation depth of the envelope in each frequency band of the stimulus, and of the co-modulation between bands. Normal-hearing (NH) listeners' discrimination of envelope rate was similar for baseline modulation rates of 5 and 34 Hz, and much poorer than previously reported for sinusoidally amplitude-modulated sounds. In contrast, discrimination of model parameters that controlled modulation depth was poorer at the lower baseline rate, consistent with the idea that, at the lower rate, subjects get fewer 'looks' at the relevant information when comparing stimuli differing in modulation depth. NH listeners could discriminate differences in co-modulation across bands; a multidimensional scaling study revealed that this was likely due to genuine across-frequency processing, rather than within-channel cues. CI users' discrimination performance was worse overall than for NH listeners, but showed a similar dependence on stimulus parameters.

Role of slow temporal modulations in speech identification for cochlear implant users

OBJECTIVE

This study aimed to assess whether the capacity of cochlear implant (CI) users to identify speech is determined by their capacity to perceive slow (< 20 Hz) temporal modulations.

DESIGN

This was achieved by studying the correlation between (1) phoneme identification in quiet and in a steady-state or fluctuating (8 Hz) noises, and (2) amplitude-modulation detection thresholds (MDTs) at 8 Hz (i.e. slow temporal modulations).

STUDY SAMPLE

Twenty-one CI users, unilaterally implanted with the same device, were tested in free field with their everyday clinical processor.

RESULTS

Extensive variability across subjects was observed for both phoneme identification and MDTs. Vowel and consonant identification scores in quiet were significantly correlated with MDTs at 8 Hz (r = - 0.47 for consonants, r = - 0.44 for vowels; p < 0.05). When the masker was a steady-state noise, only consonant identification scores tended to correlate with MDTs at 8 Hz (r = - 0.4; p = 0.07). When the masker was a fluctuating noise, consonant and vowel identification scores were not significantly correlated with MDTs at 8 Hz.

CONCLUSIONS

Sensitivity to slow amplitude modulations is correlated with vowel and consonant perception in CI users. However, reduced sensitivity to slow modulations does not entirely explain the limited capacity of CI recipients to understand speech in noise.

Duration discrimination and subjective duration for ramped and damped sounds

The perception of stimuli with ramped envelopes (gradual attack and abrupt decay) and damped envelopes (abrupt attack and gradual decay) was studied in subjective and objective tasks. Magnitude estimation (ME) of perceived duration was measured for broadband noise, 1.0-kHz, and 8.0-kHz tones for durations between 10 and 200 ms. Damped sounds were judged to be shorter than ramped sounds. Matching experiments between sounds with ramped, damped, and rectangular envelopes also showed that damped sounds are perceived to be shorter than ramped sounds, and, additionally, the reason for the effect is a result of the damped sound being judged shorter than a rectangular-gated sound rather than the ramped sound being judged longer than a rectangular-gated sound. These matching studies also demonstrate that the size of the effect is larger for tones (factor of 2.0) than for broadband noise (factor of 1.5). There are two plausible explanations for the finding that damped sounds are judged to be shorter than ramped or rectangular-gated sounds: (1) the abrupt offset at a high level of the ramped sound (or a rectangular-gated sound) results in a persistence of perception (forward masking) that is considered in judgments of the subjective duration; and (2) listeners may ignore a portion of the decay of a damped sound because they consider it an "echo" [Stecker and Hafter, J. Acoust. Soc. Am. 107, 3358-3368 (2000)]. In another experiment, duration discrimination for broadband noise with ramped, damped, and rectangular envelopes was studied as a function of duration (10 to 100 ms) to determine if differences in perceived duration are associated with the size of measured Weber fractions. A forced-choice adaptive procedure was used. Duration discrimination was poorer for noise with ramped envelopes than for noise with damped or rectangular envelopes. This result is inconsistent with differences in perceived duration and no explanation was readily apparent.

Amplitude compression in cochlear implants artificially restricts the perception of temporal asymmetry

This paper presents a study in which five cochlear implantees were asked to discriminate the timbre of stimuli with temporally asymmetric envelopes. Stimuli were damped and ramped sinusoids presented acoustically. They were transformed by the speech processor of the implant and were presented through one electrode. All cochlear implantees could discriminate the damped and ramped sinusoids when the half-life was 4 ms, the carrier frequency was 400 Hz, and the period of the envelope was 50 ms. In a second experiment, timbre discrimination performance was measured as a function of half-life for two cochlear implantees. Both showed that timbre discrimination was possible over the range 1-24 ms. In normal-hearing listeners, the range is 1-64 ms and in cochlear implantees, stimulated directly without the speech processor, the range is 1-300 ms. At long half-lives, the decrease in discrimination performance observed with the speech processor appears to be due to the amplitude compression applied by the device. The present results suggest that it may be important to ensure that cochlear implants do not restrict temporal asymmetry unduly when applying compression to control level.

Modeling temporal asymmetry in the auditory system

Sound sources in the environment produce waves that are almost invariably asymmetric in time, and human listeners are highly sensitive to temporal asymmetry. The spectral analysis and neural transduction processes in the cochlea enhance temporal asymmetry, as do time-domain models of cochlear processes, but it appears that the resulting asymmetry is not sufficient to explain the observed perceptual asymmetry. In the auditory image model (AIM) of hearing, the temporal asymmetry in the neural activity produced by the cochlea is further enhanced by the "strobed" temporal integration that converts the neural activity pattern into an auditory image, and the temporal asymmetry in the auditory image is sufficient to explain the perceptual asymmetry. Modern versions of the "duplex model" of pitch have time-domain cochlea simulations that produce neural activity with temporal asymmetry similar to that produced by AIM. In the final stage, however, they apply autocorrelation to the neural pattern and autocorrelation is a symmetric process in time. In this paper the effect of autocorrelation on temporal asymmetry is examined in a range of auditory models with varying forms of auditory filterbank, compression, and neural transduction. It is concluded that autocorrelation does not enhance temporal asymmetry and often reduces it, and that autocorrelogram models cannot explain the magnitude of the perceptual asymmetry in their current form. Then, the original version of strobed-temporal-integration is reviewed with regard to temporal asymmetry, and the delta-gamma theory of temporal asymmetry [Irino and Patterson, J. Acoust. Soc. Am. 99, 2316-2331 (1996)] is used to develop a new version of strobed-temporal-integration that is more robust and physiologically more plausible.