Detection and rate discrimination of amplitude modulation in electrical hearing

How Switching Musical Instruments Affects Pitch Discrimination for Cochlear Implant Users

OBJECTIVES

Cochlear implant (CI) users struggle with music perception. Generally, they have poorer pitch discrimination and timbre identification than peers with normal hearing, which reduces their overall music appreciation and quality of life. This study's primary aim was to characterize how the increased difficulty of comparing pitch changes across musical instruments affects CI users and their peers with no known hearing loss. The motivation is to better understand the challenges that CI users face with polyphonic music listening. The primary hypothesis was that CI users would be more affected by instrument switching than those with no known hearing loss. The rationale was that poorer pitch and timbre perception through a CI hinders the disassociation between pitch and timbre changes needed for this demanding task.

DESIGN

Pitch discrimination was measured for piano and tenor saxophone including conditions with pitch comparisons across instruments. Adult participants included 15 CI users and 15 peers with no known hearing loss. Pitch discrimination was measured for 4 note ranges centered on A2 (110 Hz), A3 (220 Hz), A4 (440 Hz), and A5 (880 Hz). The effect of instrument switching was quantified as the change in discrimination thresholds with and without instrument switching. Analysis of variance and Spearman's rank correlation were used to test group differences and relational outcomes, respectively.

RESULTS

Although CI users had worse pitch discrimination, the additional difficulty of instrument switching did not significantly differ between groups. Discrimination thresholds in both groups were about two times worse with instrument switching than without. Further analyses, however, revealed that CI users were biased toward ranking tenor saxophone higher in pitch compared with piano, whereas those with no known hearing loss were not so biased. In addition, CI users were significantly more affected by instrument switching for the A5 note range.

CONCLUSIONS

The magnitude of the effect of instrument switching on pitch resolution was similar for CI users and their peers with no known hearing loss. However, CI users were biased toward ranking tenor saxophone as higher in pitch and were significantly more affected by instrument switching for pitches near A5. These findings might reflect poorer temporal coding of fundamental frequency by CIs.

Limitations on Temporal Processing by Cochlear Implant Users: A Compilation of Viewpoints

Cochlear implant (CI) users are usually poor at using timing information to detect changes in either pitch or sound location. This deficit occurs even for listeners with good speech perception and even when the speech processor is bypassed to present simple, idealized stimuli to one or more electrodes. The present article presents seven expert opinion pieces on the likely neural bases for these limitations, the extent to which they are modifiable by sensory experience and training, and the most promising ways to overcome them in future. The article combines insights from physiology and psychophysics in cochlear-implanted humans and animals, highlights areas of agreement and controversy, and proposes new experiments that could resolve areas of disagreement.

Underlying dimensions of real-time word recognition in cochlear implant users

Word recognition is a gateway to language, linking sound to meaning. Prior work has characterized its cognitive mechanisms as a form of competition between similar-sounding words. However, it has not identified dimensions along which this competition varies across people. We sought to identify these dimensions in a population of cochlear implant users with heterogenous backgrounds and audiological profiles, and in a lifespan sample of people without hearing loss. Our study characterizes the process of lexical competition using the Visual World Paradigm. A principal component analysis reveals that people's ability to resolve lexical competition varies along three dimensions that mirror prior small-scale studies. These dimensions capture the degree to which lexical access is delayed ("Wait-and-See"), the degree to which competition fully resolves ("Sustained-Activation"), and the overall rate of activation. Each dimension is predicted by a different auditory skills and demographic factors (onset of deafness, age, cochlear implant experience). Moreover, each dimension predicts outcomes (speech perception in quiet and noise, subjective listening success) over and above auditory fidelity. Higher degrees of Wait-and-See and Sustained-Activation predict poorer outcomes. These results suggest the mechanisms of word recognition vary along a few underlying dimensions which help explain variable performance among listeners encountering auditory challenge.

Characterizing the relationship between modulation sensitivity and pitch resolution in cochlear implant users

Cochlear implants are medical devices that have restored hearing to approximately one million people around the world. Outcomes are impressive and most recipients attain excellent speech comprehension in quiet without relying on lip-reading cues, but pitch resolution is poor compared to normal hearing. Amplitude modulation of electrical stimulation is a primary cue for pitch perception in cochlear implant users. The experiments described in this article focus on the relationship between sensitivity to amplitude modulations and pitch resolution based on changes in the frequency of amplitude modulations. In the first experiment, modulation sensitivity and pitch resolution were measured in adults with no known hearing loss and in cochlear implant users with sounds presented to and processed by their clinical devices. Stimuli were amplitude-modulated sinusoids and amplitude-modulated narrow-band noises. Modulation detection and modulation frequency discrimination were measured for modulation frequencies centered on 110, 220, and 440 Hz. Pitch resolution based on changes in modulation frequency was measured for modulation depths of 25 %, 50 %, 100 %, and for a half-waved rectified modulator. Results revealed a strong linear relationship between modulation sensitivity and pitch resolution for cochlear implant users and peers with no known hearing loss. In the second experiment, cochlear implant users took part in analogous procedures of modulation sensitivity and pitch resolution but bypassing clinical sound processing using single-electrode stimulation. Results indicated that modulation sensitivity and pitch resolution was better conveyed by single-electrode stimulation than by clinical processors. Results at 440 Hz were worse, but also not well conveyed by clinical sound processing, so it remains unclear whether the 300 Hz perceptual limit described in the literature is a technological or biological limitation. These results highlight modulation depth and sensitivity as critical factors for pitch resolution in cochlear implant users and characterize the relationship that should inform the design of modulation enhancement algorithms for cochlear implants.

Review of Binaural Processing With Asymmetrical Hearing Outcomes in Patients With Bilateral Cochlear Implants

Bilateral cochlear implants (BiCIs) result in several benefits, including improvements in speech understanding in noise and sound source localization. However, the benefit bilateral implants provide among recipients varies considerably across individuals. Here we consider one of the reasons for this variability: difference in hearing function between the two ears, that is, interaural asymmetry. Thus far, investigations of interaural asymmetry have been highly specialized within various research areas. The goal of this review is to integrate these studies in one place, motivating future research in the area of interaural asymmetry. We first consider bottom-up processing, where binaural cues are represented using excitation-inhibition of signals from the left ear and right ear, varying with the location of the sound in space, and represented by the lateral superior olive in the auditory brainstem. We then consider top-down processing via predictive coding, which assumes that perception stems from expectations based on context and prior sensory experience, represented by cascading series of cortical circuits. An internal, perceptual model is maintained and updated in light of incoming sensory input. Together, we hope that this amalgamation of physiological, behavioral, and modeling studies will help bridge gaps in the field of binaural hearing and promote a clearer understanding of the implications of interaural asymmetry for future research on optimal patient interventions.

Pitch discrimination in electric hearing with inconsistent and consistent amplitude-modulation and inter-pulse rate cues

Users of cochlear implants (CIs) struggle in situations that require selective hearing to focus on a target source while ignoring other sources. One major reason for that is the limited access to timing cues such as temporal pitch or interaural time differences (ITDs). Various approaches to improve timing-cue sensitivity while maintaining speech understanding have been proposed, among them inserting extra pulses with short inter-pulse intervals (SIPIs) into amplitude-modulated (AM) high-rate pulse trains. Indeed, SIPI rates matching the naturally occurring AM rates improve pitch discrimination. For ITD, however, low SIPI rates are required, potentially mismatching the naturally occurring AM rates and thus creating unknown pitch effects. In this study, we investigated the perceptual contribution of AM and SIPI rate to pitch discrimination in five CI listeners and with two AM depths (0.1 and 0.5). Our results show that the SIPI-rate cue generally dominated the percept for both consistent and inconsistent cues. When tested with inconsistent cues, also the AM rate contributed, however, at the large AM depth only. These findings have implications when aiming at jointly improving temporal-pitch and ITD sensitivity in a future mixed-rate stimulation approach.

Relationships Between the Auditory Nerve Sensitivity to Amplitude Modulation, Perceptual Amplitude Modulation Rate Discrimination Sensitivity, and Speech Perception Performance in Postlingually Deafened Adult Cochlear Implant Users

OBJECTIVE

This study assessed the relationships between the salience of amplitude modulation (AM) cues encoded at the auditory nerve (AN), perceptual sensitivity to changes in AM rate (i.e., AM rate discrimination threshold, AMRDT), and speech perception scores in postlingually deafened adult cochlear implant (CI) users.

DESIGN

Study participants were 18 postlingually deafened adults with Cochlear Nucleus devices, including five bilaterally implanted patients. For each of 23 implanted ears, neural encoding of AM cues at 20 Hz at the AN was evaluated at seven electrode locations across the electrode array using electrophysiological measures of the electrically evoked compound action potential (eCAP). The salience of AM neural encoding was quantified by the Modulated Response Amplitude Ratio (MRAR). Psychophysical measures of AMRDT for 20 Hz modulation were evaluated in 16 ears using a three-alternative, forced-choice procedure, targeting 79.4% correct on the psychometric function. AMRDT was measured at up to five electrode locations for each test ear, including the electrode pair that showed the largest difference in the MRAR. Consonant-Nucleus-Consonant (CNC) word scores presented in quiet and in speech-shaped noise at a signal to noise ratio (SNR) of +10 dB were measured in all 23 implanted ears. Simulation tests were used to assess the variations in correlation results when using the MRAR and AMRDT measured at only one electrode location in each participant to correlate with CNC word scores. Linear Mixed Models (LMMs) were used to evaluate the relationship between MRARs/AMRDTs measured at individual electrode locations and CNC word scores. Spearman Rank correlation tests were used to evaluate the strength of association between CNC word scores measured in quiet and in noise with (1) the variances in MRARs and AMRDTs, and (2) the averaged MRAR or AMRDT across multiple electrodes tested for each participant.

RESULTS

There was no association between the MRAR and AMRDT. Using the MRAR and AMRDT measured at only one, randomly selected electrode location to assess their associations with CNC word scores could lead to opposite conclusions. Both the results of LMMs and Spearman Rank correlation tests showed that CNC word scores measured in quiet or at 10 dB SNR were not significantly correlated with the MRAR or AMRDT. In addition, the results of Spearman Rank correlation tests showed that the variances in MRARs and AMRDTs were not significantly correlated with CNC word scores measured in quiet or in noise.

CONCLUSIONS

The difference in AN sensitivity to AM cues is not the primary factor accounting for the variation in AMRDTs measured at different stimulation sites within individual CI users. The AN sensitivity to AM per se may not be a crucial factor for CNC word perception in quiet or at 10 dB SNR in postlingually deafened adult CI users. Using electrophysiological or psychophysical results measured at only one electrode location to correlate with speech perception scores in CI users can lead to inaccurate, if not wrong, conclusions.

A computational modelling framework for assessing information transmission with cochlear implants

Computational models are useful tools to investigate scientific questions that would be complicated to address using an experimental approach. In the context of cochlear-implants (CIs), being able to simulate the neural activity evoked by these devices could help in understanding their limitations to provide natural hearing. Here, we present a computational modelling framework to quantify the transmission of information from sound to spikes in the auditory nerve of a CI user. The framework includes a model to simulate the electrical current waveform sensed by each auditory nerve fiber (electrode-neuron interface), followed by a model to simulate the timing at which a nerve fiber spikes in response to a current waveform (auditory nerve fiber model). Information theory is then applied to determine the amount of information transmitted from a suitable reference signal (e.g., the acoustic stimulus) to a simulated population of auditory nerve fibers. As a use case example, the framework is applied to simulate published data on modulation detection by CI users obtained using direct stimulation via a single electrode. Current spread as well as the number of fibers were varied independently to illustrate the framework capabilities. Simulations reasonably matched experimental data and suggested that the encoded modulation information is proportional to the total neural response. They also suggested that amplitude modulation is well encoded in the auditory nerve for modulation rates up to 1000 Hz and that the variability in modulation sensitivity across CI users is partly because different CI users use different references for detecting modulation.

Assessing the Relationship Between Pitch Perception and Neural Health in Cochlear Implant Users

Various neural health estimates have been shown to indicate the density of spiral ganglion neurons in animal and modeling studies of cochlear implants (CIs). However, when applied to human CI users, these neural health estimates based on psychophysical and electrophysiological measures are not consistently correlated with each other or with the speech recognition performance. This study investigated whether the neural health estimates have stronger correlations with the temporal and place pitch sensitivity than with the speech recognition performance. On five electrodes in 12 tested ears of eight adult CI users, polarity effect (PE), multipulse integration (MPI), and interphase gap (IPG) effect on the amplitude growth function (AGF) of electrically evoked compound action potential (ECAP) were measured to estimate neural health, while thresholds of amplitude modulation frequency ranking (AMFR) and virtual channel ranking (VCR) were measured to indicate temporal and place pitch sensitivity. AzBio sentence recognition in noise was measured using the clinical CI processor for each ear. The results showed significantly poorer AMFR and VCR thresholds on the basal electrodes than on the apical and middle electrodes. Across ears and electrodes, only the IPG offset effect on ECAP AGF had a nearly significant negative correlation with the VCR threshold after removing the outliers. No significant across-ear correlations were found between the mean neural health estimates, mean pitch-ranking thresholds, and AzBio sentence recognition score. This study suggests that the central axon demyelination reflected by the IPG offset effect may be important for the place pitch sensitivity of CI users and that the IPG offset effect may be used to predict the perceptual resolution of virtual channels for CI programming.

Asymmetric temporal envelope sensitivity: Within- and across-ear envelope comparisons in listeners with bilateral cochlear implants

For listeners with bilateral cochlear implants (BiCIs), patient-specific differences in the interface between cochlear implant (CI) electrodes and the auditory nerve can lead to degraded temporal envelope information, compromising the ability to distinguish between targets of interest and background noise. It is unclear how comparisons of degraded temporal envelope information across spectral channels (i.e., electrodes) affect the ability to detect differences in the temporal envelope, specifically amplitude modulation (AM) rate. In this study, two pulse trains were presented simultaneously via pairs of electrodes in different places of stimulation, within and/or across ears, with identical or differing AM rates. Results from 11 adults with BiCIs indicated that sensitivity to differences in AM rate was greatest when stimuli were paired between different places of stimulation in the same ear. Sensitivity from pairs of electrodes was predicted by the poorer electrode in the pair or the difference in fidelity between both electrodes in the pair. These findings suggest that electrodes yielding poorer temporal fidelity act as a bottleneck to comparisons of temporal information across frequency and ears, limiting access to the cues used to segregate sounds, which has important implications for device programming and optimizing patient outcomes with CIs.

Stimulation Rate and Voice Pitch Perception in Cochlear Implants

The stimulation rate in cochlear implant (CI) sound coding, or the "carrier" rate in pulses per second (pps), is known to influence pitch perception, as well as loudness perception and sound quality. Our main objective was to investigate the effects of reduced carrier rate on the loudness and pitch of coded speech samples. We describe two experiments with 16 Nucleus® CI users, where we controlled modulation characteristics and carrier rate using Spectral and Temporal Enhanced Processing (STEP), a novel experimental multichannel sound coder. We used a fixed set of threshold and comfortable stimulation levels for each subject, obtained from clinical MAPs. In the first experiment, we determined equivalence for voice pitch ranking and voice gender categorization between the Advanced Combination Encoder (ACE), a widely used clinical strategy in Nucleus® recipients, and STEP for fundamental frequencies (F0) 120-250 Hz. In the second experiment, loudness was determined as a function of the input amplitude of speech samples for carrier rates of 1000, 500, and 250 pps per channel. Then, using equally loud sound coder programs, we evaluated the effect of carrier rate on voice pitch perception. Although nearly all subjects could categorize voice gender significantly above chance, pitch ranking varied across subjects. Overall, carrier rate did not substantially affect voice pitch ranking or voice gender categorization: as long as the carrier rate was at least twice the fundamental frequency, or when stimulation pulses for the lowest, 250 pps carrier were aligned to F0 peaks. These results indicate that carrier rates as low as 250 pps per channel are sufficient to support functional voice pitch perception for those CI users sensitive to temporal pitch cues; at least when temporal modulations and pulse timings in the coder output are well controlled by novel strategies such as STEP.

Modulation Depth Discrimination by Cochlear Implant Users

Cochlear implants (CIs) convey the amplitude envelope of speech by modulating high-rate pulse trains. However, not all of the envelope may be necessary to perceive amplitude modulations (AMs); the effective envelope depth may be limited by forward and backward masking from the envelope peaks. Three experiments used modulated pulse trains to measure which portions of the envelope can be effectively processed by CI users as a function of AM frequency. Experiment 1 used a three-interval forced-choice task to test the ability of CI users to discriminate less-modulated pulse trains from a fully modulated standard, without controlling for loudness. The stimuli in experiment 2 were identical, but a two-interval task was used in which participants were required to choose the less-modulated interval, ignoring loudness. Catch trials, in which judgements based on level or modulation depth would give opposing answers, were included. Experiment 3 employed novel stimuli whose modulation envelope could be modified below a variable point in the dynamic range, without changing the loudness of the stimulus. Overall, results showed that substantial portions of the envelope are not accurately encoded by CI users. In experiment 1, where loudness cues were available, participants on average were insensitive to changes in the bottom 30% of their dynamic range. In experiment 2, where loudness was controlled, participants appeared insensitive to changes in the bottom 50% of the dynamic range. In experiment 3, participants were insensitive to changes in the bottom 80% of the dynamic range. We discuss potential reasons for this insensitivity and implications for CI speech-processing strategies.

Advantages of Pulse Rate Compared to Modulation Frequency for Temporal Pitch Perception in Cochlear Implant Users

Most cochlear implants encode the fundamental frequency of periodic sounds by amplitude modulation of constant-rate pulsatile stimulation. Pitch perception provided by such stimulation strategies is markedly poor. Two experiments are reported here that consider potential advantages of pulse rate compared to modulation frequency for providing stimulation timing cues for pitch. The first experiment examines beat frequency distortion that occurs when modulating constant-rate pulsatile stimulation. This distortion has been reported on previously, but the results presented here indicate that distortion occurs for higher stimulation rates than previously reported. The second experiment examines pitch resolution as provided by pulse rate compared to modulation frequency. The results indicate that pitch discrimination is better with pulse rate than with modulation frequency. The advantage was large for rates near what has been suggested as the upper limit of temporal pitch perception conveyed by cochlear implants. The results are relevant to sound processing design for cochlear implants particularly for algorithms that encode fundamental frequency into deep envelope modulations or into precisely timed pulsatile stimulation.

Estimating the reduced benefit of infant-directed speech in cochlear implant-related speech processing

Caregivers modify their speech when talking to infants, a specific type of speech known as infant-directed speech (IDS). This speaking style facilitates language learning compared to adult-directed speech (ADS) in infants with normal hearing (NH). While infants with NH and those with cochlear implants (CIs) prefer listening to IDS over ADS, it is yet unknown how CI processing may affect the acoustic distinctiveness between ADS and IDS, as well as the degree of intelligibility of these. This study analyzed speech of seven female adult talkers to model the effects of simulated CI processing on (1) acoustic distinctiveness between ADS and IDS, (2) estimates of intelligibility of caregivers' speech in ADS and IDS, and (3) individual differences in caregivers' ADS-to-IDS modification and estimated speech intelligibility. Results suggest that CI processing is substantially detrimental to the acoustic distinctiveness between ADS and IDS, as well as to the intelligibility benefit derived from ADS-to-IDS modifications. Moreover, the observed variability across individual talkers in acoustic implementation of ADS-to-IDS modification and the estimated speech intelligibility was significantly reduced due to CI processing. The findings are discussed in the context of the link between IDS and language learning in infants with CIs.

Impact of Aging and the Electrode-to-Neural Interface on Temporal Processing Ability in Cochlear-Implant Users: Amplitude-Modulation Detection Thresholds

Although cochlear implants (CIs) are a viable treatment option for severe hearing loss in adults of any age, older adults may be at a disadvantage compared with younger adults. CIs deliver signals that contain limited spectral information, requiring CI users to attend to the temporal information within the signal to recognize speech. Older adults are susceptible to acquiring auditory temporal processing deficits, presenting a potential age-related limitation for recognizing speech signals delivered by CIs. The goal of this study was to measure auditory temporal processing ability via amplitude-modulation (AM) detection as a function of age in CI users. The contribution of the electrode-to-neural interface, in addition to age, was estimated using electrically evoked compound action potential (ECAP) amplitude growth functions. Within each participant, two electrodes were selected: one with the steepest ECAP slope and one with the shallowest ECAP slope, in order to represent electrodes with varied estimates of the electrode-to-neural interface. Single-electrode AM detection thresholds were measured using direct stimulation at these two electrode locations. Results revealed that AM detection ability significantly declined as a function of chronological age. ECAP slope did not significantly impact AM detection, but ECAP slope decreased (became shallower) with increasing age, suggesting that factors influencing the electrode-to-neural interface change with age. Results demonstrated a significant negative impact of chronological age on auditory temporal processing. The locus of the age-related limitation (peripheral vs. central origin), however, is difficult to evaluate because the peripheral influence (ECAPs) was correlated with the central factor (age).

Music perception and training for pediatric cochlear implant users

INTRODUCTION

Cochlear implants (CIs) are biomedical devices that restore sound perception for people with severe-to-profound sensorineural hearing loss. Most postlingually deafened CI users are able to achieve excellent speech recognition in quiet environments. However, current CI sound processors remain limited in their ability to deliver fine spectrotemporal information, making it difficult for CI users to perceive complex sounds. Limited access to complex acoustic cues such as music, environmental sounds, lexical tones, and voice emotion may have significant ramifications on quality of life, social development, and community interactions.

AREAS COVERED

The purpose of this review article is to summarize the literature on CIs and music perception, with an emphasis on music training in pediatric CI recipients. The findings have implications on our understanding of noninvasive, accessible methods for improving auditory processing and may help advance our ability to improve sound quality and performance for implantees.

EXPERT OPINION

Music training, particularly in the pediatric population, may be able to continue to enhance auditory processing even after performance plateaus. The effects of these training programs appear generalizable to non-trained musical tasks, speech prosody and, emotion perception. Future studies should employ rigorous control groups involving a non-musical acoustic intervention, standardized auditory stimuli, and the provision of feedback.

Temporal-pitch sensitivity in electric hearing with amplitude modulation and inserted pulses with short inter-pulse intervals

Listeners with cochlear implants (CIs) typically show poor sensitivity to the temporal-envelope pitch of high-rate pulse trains. Sensitivity to interaural time differences improves when adding pulses with short inter-pulse intervals (SIPIs) to high-rate pulse trains. In the current study, monaural temporal-pitch sensitivity with SIPI pulses was investigated for six CI listeners. Amplitude-modulated single-electrode stimuli, representing the coding of the fundamental frequency (F0) in the envelope of a high-rate carrier, were used. Two SIPI-insertion approaches, five modulation depths, two typical speech-F0s, and two carrier rates were tested. SIPI pulses were inserted either in every amplitude-modulation period (full-rate SIPI) to support the F0 cue or in every other amplitude-modulation period (half-rate SIPI) to circumvent a potential rate limitation at higher F0s. The results demonstrate that full-rate SIPI pulses improve temporal-pitch sensitivity across F0s and particularly at low modulation depths where envelope-pitch cues are weak. The half-rate SIPI pulses did not circumvent the limitation and further increased variability across listeners. Further, no effect of the carrier rate was found. Thus, the SIPI approach appears to be a promising approach to enhance CI listeners' access to temporal-envelope pitch cues at pulse rates used clinically.

Effects of rate and age in processing interaural time and level differences in normal-hearing and bilateral cochlear-implant listeners

Bilateral cochlear implants (BICIs) provide improved sound localization and speech understanding in noise compared to unilateral CIs. However, normal-hearing (NH) listeners demonstrate superior binaural processing abilities compared to BICI listeners. This investigation sought to understand differences between NH and BICI listeners' processing of interaural time differences (ITDs) and interaural level differences (ILDs) as a function of fine-structure and envelope rate using an intracranial lateralization task. The NH listeners were presented band-limited acoustical pulse trains and sinusoidally amplitude-modulated tones using headphones, and the BICI listeners were presented single-electrode electrical pulse trains using direct stimulation. Lateralization range increased as fine-structure rate increased for ILDs in BICI listeners. Lateralization range decreased for rates above 100 Hz for fine-structure ITDs, but decreased for rates lower or higher than 100 Hz for envelope ITDs in both groups. Lateralization ranges for ITDs were smaller for BICI listeners on average. After controlling for age, older listeners showed smaller lateralization ranges and BICI listeners had a more rapid decline for ITD sensitivity at 300 pulses per second. This work suggests that age confounds comparisons between NH and BICI listeners in temporal processing tasks and that some NH-BICI binaural processing differences persist even when age differences are adequately addressed.

Temporal Sensitivity Measured Shortly After Cochlear Implantation Predicts 6-Month Speech Recognition Outcome

OBJECTIVES

Psychoacoustic tests assessed shortly after cochlear implantation are useful predictors of the rehabilitative speech outcome. While largely independent, both spectral and temporal resolution tests are important to provide an accurate prediction of speech recognition. However, rapid tests of temporal sensitivity are currently lacking. Here, we propose a simple amplitude modulation rate discrimination (AMRD) paradigm that is validated by predicting future speech recognition in adult cochlear implant (CI) patients.

DESIGN

In 34 newly implanted patients, we used an adaptive AMRD paradigm, where broadband noise was modulated at the speech-relevant rate of ~4 Hz. In a longitudinal study, speech recognition in quiet was assessed using the closed-set Freiburger number test shortly after cochlear implantation (t0) as well as the open-set Freiburger monosyllabic word test 6 months later (t6).

RESULTS

Both AMRD thresholds at t0 (r = -0.51) and speech recognition scores at t0 (r = 0.56) predicted speech recognition scores at t6. However, AMRD and speech recognition at t0 were uncorrelated, suggesting that those measures capture partially distinct perceptual abilities. A multiple regression model predicting 6-month speech recognition outcome with deafness duration and speech recognition at t0 improved from adjusted R = 0.30 to adjusted R = 0.44 when AMRD threshold was added as a predictor.

CONCLUSIONS

These findings identify AMRD thresholds as a reliable, nonredundant predictor above and beyond established speech tests for CI outcome. This AMRD test could potentially be developed into a rapid clinical temporal-resolution test to be integrated into the postoperative test battery to improve the reliability of speech outcome prognosis.

Relationship Between Peripheral and Psychophysical Measures of Amplitude Modulation Detection in Cochlear Implant Users

OBJECTIVE

This study investigates the relationship between electrophysiological and psychophysical measures of amplitude modulation (AM) detection. Prior studies have reported both measures of AM detection recorded separately from cochlear implant (CI) users and acutely deafened animals, but no study has made both measures in the same CI users. Animal studies suggest a progressive loss of high-frequency encoding as one ascends the auditory pathway from the auditory nerve to the cortex. Because the CI speech processor uses the envelope of an ongoing acoustic signal to modulate pulse trains that are subsequently delivered to the intracochlear electrodes, it is of interest to explore auditory nerve responses to modulated stimuli. In addition, psychophysical AM detection abilities have been correlated with speech perception outcomes. Thus, the goal was to explore how the auditory nerve responds to AM stimuli and to relate those physiologic measures to perception.

DESIGN

Eight patients using Cochlear Ltd. Implants participated in this study. Electrically evoked compound action potentials (ECAPs) were recorded using a 4000 pps pulse train that was sinusoidally amplitude modulated at 125, 250, 500, and 1000 Hz rates. Responses were measured for each pulse over at least one modulation cycle for an apical, medial, and basal electrode. Psychophysical modulation detection thresholds (MDTs) were also measured via a three-alternative forced choice, two-down, one-up adaptive procedure using the same modulation frequencies and electrodes.

RESULTS

ECAPs were recorded from individual pulses in the AM pulse train. ECAP amplitudes varied sinusoidally, reflecting the sinusoidal variation in the stimulus. A modulated response amplitude (MRA) metric was calculated as the difference in the maximal and minimum ECAP amplitudes over the modulation cycles. MRA increased as modulation frequency increased, with no apparent cutoff (up to 1000 Hz). In contrast, MDTs increased as the modulation frequency increased. This trend is inconsistent with the physiologic measures. For a fixed modulation frequency, correlations were observed between MDTs and MRAs; this trend was evident at all frequencies except 1000 Hz (although only statistically significant for 250 and 500 Hz AM rates), possibly an indication of central limitations in processing of high modulation frequencies. Finally, peripheral responses were larger and psychophysical thresholds were lower in the apical electrodes relative to basal and medial electrodes, which may reflect better cochlear health and neural survival evidenced by lower preoperative low-frequency audiometric thresholds and steeper growth of neural responses in ECAP amplitude growth functions for apical electrodes.

CONCLUSIONS

Robust ECAPs were recorded for all modulation frequencies tested. ECAP amplitudes varied sinusoidally, reflecting the periodicity of the modulated stimuli. MRAs increased as the modulation frequency increased, a trend we attribute to neural adaptation. For low modulation frequencies, there are multiple current steps between the peak and valley of the modulation cycle, which means successive stimuli are more similar to one another and neural responses are more likely to adapt. Higher MRAs were correlated with lower psychophysical thresholds at low modulation frequencies but not at 1000 Hz, implying a central limitation to processing of modulated stimuli.

Rate modulation detection thresholds for cochlear implant users

The perception of temporal amplitude modulations is critical for speech understanding by cochlear implant (CI) users. The present study compared the ability of CI users to detect sinusoidal modulations of the electrical stimulation rate and current level, at different presentation levels (80% and 40% of the dynamic range) and modulation frequencies (10 and 100 Hz). Rate modulation detection thresholds (RMDTs) and amplitude modulation detection thresholds (AMDTs) were measured and compared to assess whether there was a perceptual advantage to either modulation method. Both RMDTs and AMDTs improved with increasing presentation level and decreasing modulation frequency. RMDTs and AMDTs were correlated, indicating that a common processing mechanism may underlie the perception of rate modulation and amplitude modulation, or that some subject-dependent factors affect both types of modulation detection.

Depth matters - Towards finding an objective neurophysiological measure of behavioral amplitude modulation detection based on neural threshold determination

With increasing numbers undergoing intervention for hearing impairment at a young age, the clinical need for objective assessment tools of auditory discrimination abilities is growing. Amplitude modulation (AM) sensitivity has been known to be an important factor for speech recognition particularly among cochlear implant (CI) users. It therefore would be useful to develop objective measures of AM detection for future clinical assessment of CI users; this study aimed to verify the feasibility of a neurophysiological approach studying a cohort of normal-hearing participants. The mismatch waveform (MMW) was evaluated as a potential objective measure of AM detection for a low modulation rate (8 Hz). This study also explored the relationship between behavioral AM detection and speech-in-noise recognition. The following measures were obtained for 15 young adults with no known hearing impairment: (1) psychoacoustic sinusoidal AM detection ability for a modulation rate of 8 Hz; (2) neural AM detection thresholds estimated from morphology weighted cortical auditory evoked potentials elicited to various AM depths; and (3) AzBio sentence scores for speech-in-noise recognition. No significant correlations were found between speech recognition and behavioral AM detection measures. Individual neural thresholds were obtained from MMW data and showed significant positive correlations with behavioral AM detection thresholds. Neural thresholds estimated from morphology weighted MMWs provide a novel, objective approach for assessing low-rate AM detection. The findings of this study encourage the continued investigation of the MMW as a neural correlate of low-rate AM detection in larger normal-hearing cohorts and subsequently in clinical cohorts such as cochlear implant users.

Band importance functions of listeners with cochlear implants using clinical maps

Band importance functions estimate the relative contribution of individual acoustic frequency bands to speech intelligibility. Previous studies of band importance in listeners with cochlear implants have used experimental maps and direct stimulation. Here, band importance was estimated for clinical maps with acoustic stimulation. Listeners with cochlear implants had band importance functions that relied more heavily on lower frequencies and showed less cross-listener consistency than in listeners with normal hearing. The intersubject variability observed here indicates that averaging band importance functions across listeners with cochlear implants, as has been done in previous studies, may not be meaningful. Additionally, band importance functions of listeners with normal hearing for vocoded speech that either did or did not simulate spread of excitation were not different from one another, suggesting that additional factors beyond spread of excitation are necessary to account for changes in band importance in listeners with cochlear implants.

Rate discrimination at low pulse rates in normal-hearing and cochlear implant listeners: Influence of intracochlear stimulation site

Temporal pitch perception in cochlear implantees remains weaker than in normal hearing listeners and is usually limited to rates below about 300 pulses per second (pps). Recent studies have suggested that stimulating the apical part of the cochlea may improve the temporal coding of pitch by cochlear implants (CIs), compared to stimulating other sites. The present study focuses on rate discrimination at low pulse rates (ranging from 20 to 104 pps). Two experiments measured and compared pulse rate difference limens (DLs) at four fundamental frequencies (ranging from 20 to 104 Hz) in both CI and normal-hearing (NH) listeners. Experiment 1 measured DLs in users of the (Med-El CI, Innsbruck, Austria) device for two electrodes (one apical and one basal). In experiment 2, DLs for NH listeners were compared for unresolved harmonic complex tones filtered in two frequency regions (lower cut-off frequencies of 1200 and 3600 Hz, respectively) and for different bandwidths. Pulse rate discrimination performance was significantly better when stimulation was provided by the apical electrode in CI users and by the lower-frequency tone complexes in NH listeners. This set of data appears consistent with better temporal coding when stimulation originates from apical regions of the cochlea.

Perception of stochastic envelopes by normal-hearing and cochlear-implant listeners

We assessed auditory sensitivity to three classes of temporal-envelope statistics (modulation depth, modulation rate, and comodulation) that are important for the perception of 'sound textures'. The textures were generated by a probabilistic model that prescribes the temporal statistics of a selected number of modulation envelopes, superimposed onto noise carriers. Discrimination thresholds were measured for normal-hearing (NH) listeners and users of a MED-EL pulsar cochlear implant (CI), for separate manipulations of the average rate and modulation depth of the envelope in each frequency band of the stimulus, and of the co-modulation between bands. Normal-hearing (NH) listeners' discrimination of envelope rate was similar for baseline modulation rates of 5 and 34 Hz, and much poorer than previously reported for sinusoidally amplitude-modulated sounds. In contrast, discrimination of model parameters that controlled modulation depth was poorer at the lower baseline rate, consistent with the idea that, at the lower rate, subjects get fewer 'looks' at the relevant information when comparing stimuli differing in modulation depth. NH listeners could discriminate differences in co-modulation across bands; a multidimensional scaling study revealed that this was likely due to genuine across-frequency processing, rather than within-channel cues. CI users' discrimination performance was worse overall than for NH listeners, but showed a similar dependence on stimulus parameters.

Envelope Interactions in Multi-Channel Amplitude Modulation Frequency Discrimination by Cochlear Implant Users

Rationale

Previous cochlear implant (CI) studies have shown that single-channel amplitude modulation frequency discrimination (AMFD) can be improved when coherent modulation is delivered to additional channels. It is unclear whether the multi-channel advantage is due to increased loudness, multiple envelope representations, or to component channels with better temporal processing. Measuring envelope interference may shed light on how modulated channels can be combined.

Methods

In this study, multi-channel AMFD was measured in CI subjects using a 3-alternative forced-choice, non-adaptive procedure (“which interval is different?”). For the reference stimulus, the reference AM (100 Hz) was delivered to all 3 channels. For the probe stimulus, the target AM (101, 102, 104, 108, 116, 132, 164, 228, or 256 Hz) was delivered to 1 of 3 channels, and the reference AM (100 Hz) delivered to the other 2 channels. The spacing between electrodes was varied to be wide or narrow to test different degrees of channel interaction.

Results

Results showed that CI subjects were highly sensitive to interactions between the reference and target envelopes. However, performance was non-monotonic as a function of target AM frequency. For the wide spacing, there was significantly less envelope interaction when the target AM was delivered to the basal channel. For the narrow spacing, there was no effect of target AM channel. The present data were also compared to a related previous study in which the target AM was delivered to a single channel or to all 3 channels. AMFD was much better with multiple than with single channels whether the target AM was delivered to 1 of 3 or to all 3 channels. For very small differences between the reference and target AM frequencies (2–4 Hz), there was often greater sensitivity when the target AM was delivered to 1 of 3 channels versus all 3 channels, especially for narrowly spaced electrodes.

Conclusions

Besides the increased loudness, the present results also suggest that multiple envelope representations may contribute to the multi-channel advantage observed in previous AMFD studies. The different patterns of results for the wide and narrow spacing suggest a peripheral contribution to multi-channel temporal processing. Because the effect of target AM frequency was non-monotonic in this study, adaptive procedures may not be suitable to measure AMFD thresholds with interfering envelopes. Envelope interactions among multiple channels may be quite complex, depending on the envelope information presented to each channel and the relative independence of the stimulated channels.

Fundamental-frequency discrimination using noise-band-vocoded harmonic complexes in older listeners with normal hearing

Voice-pitch cues provide detailed information about a talker that help a listener to understand speech in complex environments. Temporal-envelope based voice-pitch coding is important for listeners with hearing impairment, especially listeners with cochlear implants, as spectral resolution is not sufficient to provide a spectrally based voice-pitch cue. The effect of aging on the ability to glean voice-pitch information using temporal envelope cues is not completely understood. The current study measured fundamental frequency (f0) discrimination limens in normal-hearing younger and older adults while listening to noise-band vocoded harmonic complexes with varying numbers of spectral channels. Age-related disparities in performance were apparent across all conditions, independent of spectral degradation and/or fundamental frequency. The findings have important implications for older listeners with normal hearing and hearing loss, who may be inherently limited in their ability to perceive f0 cues due to senescent decline in auditory function.

Melodic pitch perception and lexical tone perception in Mandarin-speaking cochlear implant users

OBJECTIVES

To examine the relationship between lexical tone perception and melodic pitch perception in Mandarin-speaking cochlear implant (CI) users and to investigate the influence of previous acoustic hearing on CI users' speech and music perception.

DESIGN

Lexical tone perception and melodic contour identification (MCI) were measured in 21 prelingual and 11 postlingual young (aged 6-26 years) Mandarin-speaking CI users. Lexical tone recognition was measured for four tonal patterns: tone 1 (flat F0), tone 2 (rising F0), tone 3 (falling-rising F0), and tone 4 (falling F0). MCI was measured using nine five-note melodic patterns that contained changes in pitch contour, as well as different semitone spacing between notes.

RESULTS

Lexical tone recognition was generally good (overall mean = 81% correct), and there was no significant difference between subject groups. MCI performance was generally poor (mean = 23% correct). MCI performance was significantly better for postlingual (mean = 32% correct) than for prelingual CI participants (mean = 18% correct). After correcting for outliers, there was no significant correlation between lexical tone recognition and MCI performance for prelingual or postlingual CI participants. Age at deafness was significantly correlated with MCI performance only for postlingual participants. CI experience was significantly correlated with MCI performance for both prelingual and postlingual participants. Duration of deafness was significantly correlated with tone recognition only for prelingual participants.

CONCLUSIONS

Despite the prevalence of pitch cues in Mandarin, the present CI participants had great difficulty perceiving melodic pitch. The availability of amplitude and duration cues in lexical tones most likely compensated for the poor pitch perception observed with these CI listeners. Previous acoustic hearing experience seemed to benefit postlingual CI users' melodic pitch perception. Longer CI experience was associated with better MCI performance for both subject groups, suggesting that CI users' music perception may improve as they gain experience with their device.

Voice emotion recognition by cochlear-implanted children and their normally-hearing peers

Despite their remarkable success in bringing spoken language to hearing impaired listeners, the signal transmitted through cochlear implants (CIs) remains impoverished in spectro-temporal fine structure. As a consequence, pitch-dominant information such as voice emotion, is diminished. For young children, the ability to correctly identify the mood/intent of the speaker (which may not always be visible in their facial expression) is an important aspect of social and linguistic development. Previous work in the field has shown that children with cochlear implants (cCI) have significant deficits in voice emotion recognition relative to their normally hearing peers (cNH). Here, we report on voice emotion recognition by a cohort of 36 school-aged cCI. Additionally, we provide for the first time, a comparison of their performance to that of cNH and NH adults (aNH) listening to CI simulations of the same stimuli. We also provide comparisons to the performance of adult listeners with CIs (aCI), most of whom learned language primarily through normal acoustic hearing. Results indicate that, despite strong variability, on average, cCI perform similarly to their adult counterparts; that both groups' mean performance is similar to aNHs' performance with 8-channel noise-vocoded speech; that cNH achieve excellent scores in voice emotion recognition with full-spectrum speech, but on average, show significantly poorer scores than aNH with 8-channel noise-vocoded speech. A strong developmental effect was observed in the cNH with noise-vocoded speech in this task. These results point to the considerable benefit obtained by cochlear-implanted children from their devices, but also underscore the need for further research and development in this important and neglected area. This article is part of a Special Issue entitled .

Modulation frequency discrimination with single and multiple channels in cochlear implant users

Temporal envelope cues convey important speech information for cochlear implant (CI) users. Many studies have explored CI users' single-channel temporal envelope processing. However, in clinical CI speech processors, temporal envelope information is processed by multiple channels. Previous studies have shown that amplitude modulation frequency discrimination (AMFD) thresholds are better when temporal envelopes are delivered to multiple rather than single channels. In clinical fitting, current levels on single channels must often be reduced to accommodate multi-channel loudness summation. As such, it is unclear whether the multi-channel advantage in AMFD observed in previous studies was due to coherent envelope information distributed across the cochlea or to greater loudness associated with multi-channel stimulation. In this study, single- and multi-channel AMFD thresholds were measured in CI users. Multi-channel component electrodes were either widely or narrowly spaced to vary the degree of overlap between neural populations. The reference amplitude modulation (AM) frequency was 100 Hz, and coherent modulation was applied to all channels. In Experiment 1, single- and multi-channel AMFD thresholds were measured at similar loudness. In this case, current levels on component channels were higher for single-than for multi-channel AM stimuli, and the modulation depth was approximately 100% of the perceptual dynamic range (i.e., between threshold and maximum acceptable loudness). Results showed no significant difference in AMFD thresholds between similarly loud single- and multi-channel modulated stimuli. In Experiment 2, single- and multi-channel AMFD thresholds were compared at substantially different loudness. In this case, current levels on component channels were the same for single- and multi-channel stimuli ("summation-adjusted" current levels) and the same range of modulation (in dB) was applied to the component channels for both single- and multi-channel testing. With the summation-adjusted current levels, loudness was lower with single than with multiple channels and the AM depth resulted in substantial stimulation below single-channel audibility, thereby reducing the perceptual range of AM. Results showed that AMFD thresholds were significantly better with multiple channels than with any of the single component channels. There was no significant effect of the distribution of electrodes on multi-channel AMFD thresholds. The results suggest that increased loudness due to multi-channel summation may contribute to the multi-channel advantage in AMFD, and that overall loudness may matter more than the distribution of envelope information in the cochlea.

Speech perception in tones and noise via cochlear implants reveals influence of spectral resolution on temporal processing

Under normal conditions, human speech is remarkably robust to degradation by noise and other distortions. However, people with hearing loss, including those with cochlear implants, often experience great difficulty in understanding speech in noisy environments. Recent work with normal-hearing listeners has shown that the amplitude fluctuations inherent in noise contribute strongly to the masking of speech. In contrast, this study shows that speech perception via a cochlear implant is unaffected by the inherent temporal fluctuations of noise. This qualitative difference between acoustic and electric auditory perception does not seem to be due to differences in underlying temporal acuity but can instead be explained by the poorer spectral resolution of cochlear implants, relative to the normally functioning ear, which leads to an effective smoothing of the inherent temporal-envelope fluctuations of noise. The outcome suggests an unexpected trade-off between the detrimental effects of poorer spectral resolution and the beneficial effects of a smoother noise temporal envelope. This trade-off provides an explanation for the long-standing puzzle of why strong correlations between speech understanding and spectral resolution have remained elusive. The results also provide a potential explanation for why cochlear-implant users and hearing-impaired listeners exhibit reduced or absent masking release when large and relatively slow temporal fluctuations are introduced in noise maskers. The multitone maskers used here may provide an effective new diagnostic tool for assessing functional hearing loss and reduced spectral resolution.

Speech perception in tones and noise via cochlear implants reveals influence of spectral resolution on temporal processing

Under normal conditions, human speech is remarkably robust to degradation by noise and other distortions. However, people with hearing loss, including those with cochlear implants, often experience great difficulty in understanding speech in noisy environments. Recent work with normal-hearing listeners has shown that the amplitude fluctuations inherent in noise contribute strongly to the masking of speech. In contrast, this study shows that speech perception via a cochlear implant is unaffected by the inherent temporal fluctuations of noise. This qualitative difference between acoustic and electric auditory perception does not seem to be due to differences in underlying temporal acuity but can instead be explained by the poorer spectral resolution of cochlear implants, relative to the normally functioning ear, which leads to an effective smoothing of the inherent temporal-envelope fluctuations of noise. The outcome suggests an unexpected trade-off between the detrimental effects of poorer spectral resolution and the beneficial effects of a smoother noise temporal envelope. This trade-off provides an explanation for the long-standing puzzle of why strong correlations between speech understanding and spectral resolution have remained elusive. The results also provide a potential explanation for why cochlear-implant users and hearing-impaired listeners exhibit reduced or absent masking release when large and relatively slow temporal fluctuations are introduced in noise maskers. The multitone maskers used here may provide an effective new diagnostic tool for assessing functional hearing loss and reduced spectral resolution.

Is there a fundamental 300 Hz limit to pulse rate discrimination in cochlear implants?

Literature often refers to a 300 pps limit for cochlear implant (CI) electrical stimulation, above which pulse rate discrimination deteriorates or above which rate pitch is not perceived to increase. The present study investigated the effect on pulse rate difference limens (PRDLs) when using compound stimuli in which identical pulse trains were applied to multiple electrodes across the length of the electrode array and compared the results to those of single-electrode stimuli. PRDLs of seven CI users were determined in two stimulus pulse phase conditions, one in which the phase delays between pulses on different electrodes were minimised (burst mode) and a second in which they were maximised (spread mode). PRDLs were measured at base rates of 100 to 600 pps in 100 pps intervals, using compound stimuli on one, two, five, nine and 18 electrodes. As smaller PRDLs were expected to reflect improved rate pitch perception, 18-electrode spread mode stimuli were also included in a pitch ranking task. PRDLs improved markedly when multi-electrode compound stimuli were used, with average spread mode PRDLs across listeners between 6 and 8 % of the base rate in the whole range tested (i.e. up to 600 pps). PRDLs continued to improve as more electrodes were included, up to at least nine electrodes in the compound stimulus. Stimulus pulse phase had a significant influence on the results, with PRDLs being smaller in spread mode. Results indicate that pulse rate discrimination may be manipulated with stimulus parameter choice so that previously observed deterioration of PRDLs at 300 pps probably does not reflect a fundamental limitation to rate discrimination. However, rate pitch perception did not improve in the conditions that resulted in smaller PRDLs. This may indicate that listeners used cues other than pitch to perform the rate discrimination task or may reflect limitations in the electrically evoked neural excitation patterns presented to a rate pitch extraction mechanism.

Single- and multi-channel modulation detection in cochlear implant users

Single-channel modulation detection thresholds (MDTs) have been shown to predict cochlear implant (CI) users' speech performance. However, little is known about multi-channel modulation sensitivity. Two factors likely contribute to multichannel modulation sensitivity: multichannel loudness summation and the across-site variance in single-channel MDTs. In this study, single- and multi-channel MDTs were measured in 9 CI users at relatively low and high presentation levels and modulation frequencies. Single-channel MDTs were measured at widely spaced electrode locations, and these same channels were used for the multichannel stimuli. Multichannel MDTs were measured twice, with and without adjustment for multichannel loudness summation (i.e., at the same loudness as for the single-channel MDTs or louder). Results showed that the effect of presentation level and modulation frequency were similar for single- and multi-channel MDTs. Multichannel MDTs were significantly poorer than single-channel MDTs when the current levels of the multichannel stimuli were reduced to match the loudness of the single-channel stimuli. This suggests that, at equal loudness, single-channel measures may over-estimate CI users' multichannel modulation sensitivity. At equal loudness, there was no significant correlation between the amount of multichannel loudness summation and the deficit in multichannel MDTs, relative to the average single-channel MDT. With no loudness compensation, multichannel MDTs were significantly better than the best single-channel MDT. The across-site variance in single-channel MDTs varied substantially across subjects. However, the across-site variance was not correlated with the multichannel advantage over the best single channel. This suggests that CI listeners combined envelope information across channels instead of attending to the best channel.

Interpulse interval discrimination within and across channels: comparison of monopolar and tripolar mode of stimulation

Perception of temporal patterns is crucial to speech understanding and music perception in normal hearing, and is fundamental in the design and implementation of processing strategies for cochlear implants. Two experiments described here investigated the effect of stimulation mode (monopolar versus tripolar) on interpulse interval discrimination using single-electrode stimulation (experiment 1) and dual-electrode stimulation (experiment 2). Experiment 1 required participants to discriminate stimuli containing different interpulse intervals and experiment 2 required listeners to discriminate between two dual-electrode stimuli that had the same temporal pattern on each electrode, but differed in inter-electrode timing. The hypotheses were that (i) stimulation mode would affect the ability to distinguish interpulse interval patterns on a single electrode and (ii) the electrode separation range in which subjects were sensitive to inter-electrode timing would be more restricted in tripolar than in monopolar stimulation. Results in nine cochlear implant users showed that mode did not have a significant mean effect on either the ability to discriminate interpulse intervals in single-electrode stimulation or the range of electrode separation in dual-electrode stimulation in which participants were sensitive to inter-electrode timing. In conclusion, tripolar stimulation did not show any advantage in delivering temporal information within or across channels in this group.

Association of auditory steady state responses with perception of temporal modulations and speech in noise

Amplitude modulations in the speech convey important acoustic information for speech perception. Auditory steady state response (ASSR) is thought to be physiological correlate of amplitude modulation perception. Limited research is available exploring association between ASSR and modulation detection ability as well as speech perception. Correlation of modulation detection thresholds (MDT) and speech perception in noise with ASSR was investigated in twofold experiments. 30 normal hearing individuals and 11 normal hearing individuals within age range of 18–24 years participated in experiments 1 and 2, respectively. MDTs were measured using ASSR and behavioral method at 60 Hz, 80 Hz, and 120 Hz modulation frequencies in the first experiment. ASSR threshold was obtained by estimating the minimum modulation depth required to elicit ASSR (ASSR-MDT). There was a positive correlation between behavioral MDT and ASSR-MDT at all modulation frequencies. In the second experiment, ASSR for amplitude modulation (AM) sweeps at four different frequency ranges (30–40 Hz, 40–50 Hz, 50–60 Hz, and 60–70 Hz) was recorded. Speech recognition threshold in noise (SRTn) was estimated using staircase procedure. There was a positive correlation between amplitude of ASSR for AM sweep with frequency range of 30–40 Hz and SRTn. Results of the current study suggest that ASSR provides substantial information about temporal modulation and speech perception.

The effect of enhancing temporal periodicity cues on Cantonese tone recognition by cochlear implantees

OBJECTIVES

This study investigates the efficacy of a cochlear implant (CI) processing method that enhances temporal periodicity cues of speech.

DESIGN

Subjects participated in word and tone identification tasks. Two processing conditions - the conventional advanced combination encoder (ACE) and tone-enhanced ACE were tested. Test materials were Cantonese disyllabic words recorded from one male and one female speaker. Speech-shaped noise was added to clean speech. The fundamental frequency information for periodicity enhancement was extracted from the clean speech. Electrical stimuli generated from the noisy speech with and without periodicity enhancement were presented via direct stimulation using a Laura 34 research processor. Subjects were asked to identify the presented word.

STUDY SAMPLE

Seven post-lingually deafened native Cantonese-speaking CI users.

RESULTS

Percent correct word, segmental structure, and tone identification scores were calculated. While word and segmental structure identification accuracy remained similar between the two processing conditions, tone identification in noise was better with tone-enhanced ACE than with conventional ACE. Significant improvement on tone perception was found only for the female voice.

CONCLUSIONS

Temporal periodicity cues are important to tone perception in noise. Pitch and tone perception by CI users could be improved when listeners received enhanced temporal periodicity cues.

A method to dynamically control unwanted loudness cues when measuring amplitude modulation detection in cochlear implant users

BACKGROUND

Amplitude modulation (AM) detection is a measure of temporal processing that has been correlated with cochlear implant (CI) users' speech understanding. For CI users, AM stimuli have been shown to be louder than steady-state (non-AM) stimuli presented at the same reference current level, suggesting that unwanted loudness cues might contribute to CI users' AM sensitivity as measured in a modulation detection task. In this paper, a new method is introduced to dynamically control unwanted AM loudness cues when adaptively measuring modulation detection thresholds (MDTs) in CI users.

METHODS

MDTs were adaptively measured in 9 CI subjects using a three-alternative, forced-choice procedure, with and without dynamic control of unwanted AM loudness cues. To control for AM loudness cues during the MDT task, the level of the steady-state (non-AM) stimuli was increased to match the loudness of the AM stimulus using a non-linear amplitude scaling function, which was obtained by first loudness-balancing non-AM stimuli to AM stimuli at various modulation depths. To further protect against unwanted loudness cues, ±0.75dB of level roving was also applied to all stimuli during the MDT task.

RESULTS

Absolute MDTs were generally poorer when unwanted AM loudness cues were controlled. However, the effects of modulation frequency and presentation level on modulation sensitivity were fundamentally unchanged by the availability of AM loudness cues.

CONCLUSIONS

The data suggest that the present method controlling for unwanted AM loudness cues might better represent CI users' MDTs, without changing fundamental effects of modulation frequency and presentation level on CI users' modulation sensitivity.

Temporal processing in the auditory system: insights from cochlear and auditory midbrain implantees

Central auditory processing in humans was investigated by comparing the perceptual effects of temporal parameters of electrical stimulation in auditory midbrain implant (AMI) and cochlear implant (CI) users. Four experiments were conducted to measure the following: effect of interpulse intervals on detection thresholds and loudness; temporal modulation transfer functions (TMTFs); effect of duration on detection thresholds; and forward masking decay. The CI data were consistent with a phenomenological model that based detection or loudness decisions on the output of a sliding temporal integration window, the input to which was the hypothetical auditory nerve response to each stimulus pulse. To predict the AMI data, the model required changes to both the neural response input (i.e., midbrain activity to AMI stimuli, compared to auditory nerve activity to CI stimuli) and the shape of the integration window. AMI data were consistent with a neural response that decreased more steeply compared to CI stimulation as the pulse rate increased or interpulse interval decreased. For one AMI subject, the data were consistent with a significant adaptation of the neural response for rates above 200 Hz. The AMI model required an integration window that was significantly wider (i.e., decreased temporal resolution) than that for CI data, the latter being well fit using the same integration window shape as derived from normal-hearing data. These models provide a useful way to conceptualize how stimulation of central auditory structures differs from stimulation of the auditory nerve and to better understand why AMI users have difficulty processing temporal cues important for speech understanding.

Temporal modulation transfer functions in cochlear implantees using a method that limits overall loudness cues

Temporal modulation transfer functions (TMTFs) were measured for six users of cochlear implants, using different carrier rates and levels. Unlike most previous studies investigating modulation detection, the experimental design limited potential effects of overall loudness cues. Psychometric functions (percent correct discrimination of modulated from unmodulated stimuli versus modulation depth) were obtained. For each modulation depth, each modulated stimulus was loudness balanced to the unmodulated reference stimulus, and level jitter was applied in the discrimination task. The loudness-balance data showed that the modulated stimuli were louder than the unmodulated reference stimuli with the same average current, thus confirming the need to limit loudness cues when measuring modulation detection. TMTFs measured in this way had a low-pass characteristic, with a cut-off frequency (at comfortably loud levels) similar to that for normal-hearing listeners. A reduction in level caused degradation in modulation detection efficiency and a lower-cut-off frequency (i.e. poorer temporal resolution). An increase in carrier rate also led to a degradation in modulation detection efficiency, but only at lower levels or higher modulation frequencies. When detection thresholds were expressed as a proportion of dynamic range, there was no effect of carrier rate for the lowest modulation frequency (50 Hz) at either level.