Neural speech tracking shifts from the syllabic to the modulation rate of speech as intelligibility decreases

The most prominent acoustic features in speech are intensity modulations, represented by the amplitude envelope of speech. Synchronization of neural activity with these modulations supports speech comprehension. As the acoustic modulation of speech is related to the production of syllables, investigations of neural speech tracking commonly do not distinguish between lower-level acoustic (envelope modulation) and higher-level linguistic (syllable rate) information. Here we manipulated speech intelligibility using noise-vocoded speech and investigated the spectral dynamics of neural speech processing, across two studies at cortical and subcortical levels of the auditory hierarchy, using magnetoencephalography. Overall, cortical regions mostly track the syllable rate, whereas subcortical regions track the acoustic envelope. Furthermore, with less intelligible speech, tracking of the modulation rate becomes more dominant. Our study highlights the importance of distinguishing between envelope modulation and syllable rate and provides novel possibilities to better understand differences between auditory processing and speech/language processing disorders.

The effect of phoneme-based auditory training on speech intelligibility in hearing-aid users

OBJECTIVE

Hearing loss commonly causes difficulties in understanding speech in the presence of background noise. The benefits of hearing-aids in terms of speech intelligibility in challenging listening scenarios remain limited. The present study investigated if phoneme-in-noise discrimination training improves phoneme identification and sentence intelligibility in noise in hearing-aid users.

DESIGN

Two groups of participants received either a two-week training program or a control intervention. Three phoneme categories were trained: onset consonants (C1), vowels (V) and post-vowel consonants (C2) in C1-V-C2-/i/ logatomes from the Danish nonsense word corpus (DANOK). Phoneme identification test and hearing in noise test (HINT) were administered before and after the respective interventions and, for the training group only, after three months.

STUDY SAMPLE

Twenty 63-to-79 years old individuals with a mild-to-moderate sensorineural hearing loss and at least one year of experience using hearing-aids.

RESULTS

The training provided an improvement in phoneme identification scores for vowels and post-vowel consonants, which was retained over three months. No significant performance improvement in HINT was found.

CONCLUSION

The study demonstrates that the training induced a robust refinement of auditory perception at a phoneme level but provides no evidence for the generalisation to an untrained sentence intelligibility task.

Speech Tracking in Complex Auditory Scenes with Differentiated In- and Out-Field-Of-View Processing in Hearing Aids

In naturalistic auditory scenes, relevant information is rarely concentrated at a single location, but rather unpredictably scattered in- and out-field-of-view (in-/out-FOV). Although the parsing of a complex auditory scene is a fairly simple job for a healthy human auditory system, the uncertainty represents a major issue in the development of effective hearing aid (HA) processing strategies. Whereas traditional omnidirectional microphones (OM) amplify the complete auditory scene without enhancing signal-to-noise-ratio (SNR) between in- and out-FOV streams, directional microphones (DM) may greatly increase SNR at the cost of preventing HA users to perceive out-FOV information. The present study compares the conventional OM and DM HA settings to a split processing (SP) scheme differentiating between in- and out-FOV processing. We recorded electroencephalographic data of ten young, normal-hearing listeners who solved a cocktail-party-scenario-paradigm with continuous auditory streams and analyzed neural tracking of speech with a stimulus reconstruction (SR) approach. While results for all settings exhibited significantly higher SR accuracies for attended in-FOV than unattended out-FOV streams, there were distinct differences between settings. In-FOV SR performance was dominated by DM and SP and out-FOV SR accuracies were significantly higher for SP compared to OM and DM. Our results demonstrate the potential of a SP approach to combine the advantages of traditional OM and DM settings without introduction of significant compromises.

Evaluation of an objective listening effort measure in a selective, multi-speaker listening task using different hearing aid settings

Speaker recognition in a multi-speaker environment is a complex listening task that requires effort to be solved. Especially people with hearing loss show an increased listening effort in demanding listening situations compared to normal hearing people. However, a standardized method to quantify listening effort does not exist yet. Recently we have shown a possible way to determine listening effort objectively. The aim of this study was to validate the proposed objective measure in a challenging, true-to-life listening situation, and to get an insight on the influence of different hearing aid (HA) settings on the listening effort using the proposed measure. To achieve this we investigated the influence of four different HA settings and two different listening task difficulties (LTD) on the listening effort of people with hearing loss in a selective, real-speech listening task. HA setting A, B and C all had an adaptive compression with static characteristic, but differed in the gain and compression settings (more and less gain and more and less linear). Setting D had an adaptive compression whose characteristic was situation-dependent. To quantify the listening effort the ongoing oscillatory EEG activity was recorded as the basis to calculate the objective measure (OLEosc). By way of comparison a subjective listening effort score was determined on an individual basis (SLEscr). The results show that the OLEosc maps the SLEscr well in every of the tested conditions. Furthermore, the results also suggest that OLEosc might be more sensitive to small variances in listening effort than the employed subjective rating scale.

Computer-based auditory phoneme discrimination training improves speech recognition in noise in experienced adult cochlear implant listeners

OBJECTIVE

Specific computer-based auditory training may be a useful completion in the rehabilitation process for cochlear implant (CI) listeners to achieve sufficient speech intelligibility. This study evaluated the effectiveness of a computerized, phoneme-discrimination training programme.

DESIGN

The study employed a pretest-post-test design; participants were randomly assigned to the training or control group. Over a period of three weeks, the training group was instructed to train in phoneme discrimination via computer, twice a week. Sentence recognition in different noise conditions (moderate to difficult) was tested pre- and post-training, and six months after the training was completed. The control group was tested and retested within one month.

STUDY SAMPLE

Twenty-seven adult CI listeners who had been using cochlear implants for more than two years participated in the programme; 15 adults in the training group, 12 adults in the control group.

RESULTS

Besides significant improvements for the trained phoneme-identification task, a generalized training effect was noted via significantly improved sentence recognition in moderate noise. No significant changes were noted in the difficult noise conditions. Improved performance was maintained over an extended period.

CONCLUSIONS

Phoneme-discrimination training improves experienced CI listeners' speech perception in noise. Additional research is needed to optimize auditory training for individual benefit.

Enhancement, adaptation, and the binaural system

In a test sound consisting of a burst of pink noise, an arbitrarily selected target frequency band can be "enhanced" by the previous presentation of a similar noise with a spectral notch in the target frequency region. As a result of the enhancement, the test sound evokes a pitch sensation corresponding to the pitch of the target band. Here, a pitch comparison task was used to assess enhancement. In the first experiment, a stronger enhancement effect was found when the test sound and its precursor had the same interaural time difference (ITD) than when they had opposite ITDs. Two subsequent experiments were concerned with the audibility of an instance of dichotic pitch in binaural test sounds preceded by precursors. They showed that it is possible to enhance a frequency region on the sole basis of ITD manipulations, using spectrally identical test sounds and precursors. However, the observed effects were small. A major goal of this study was to test the hypothesis that enhancement originates at least in part from neural adaptation processes taking place at a central level of the auditory system. The data failed to provide strong support for this hypothesis.

Auditory change detection: simple sounds are not memorized better than complex sounds

Previous research has shown that the detectability of a local change in a visual image is essentially independent of the complexity of the image when the interstimulus interval (ISI) is very short, but is limited by a low-capacity memory system when the ISI exceeds 100 ms. In the study reported here, listeners made same/different judgments on pairs of successive "chords" (sums of pure tones with random frequencies). The change to be detected was always a frequency shift in one of the tones, and which tone would change was unpredictable. Performance worsened as the number of tones increased, but this effect was not larger for 2-s ISIs than for 0-ms ISIs. Similar results were obtained when a chord was followed by a single tone that had to be judged as higher or lower than the closest component of the chord. Overall, our data suggest that change detection is based on different mechanisms in audition and vision.

Modelling neural informational propagation and functional auditory sensory memory with temporal multi-scale operators

In this paper we prove that both diffusion and the leaky integrators cascade based transport mechanisms have as their inherent property the effect of temporal multi-scaling. The two transport mechanisms are modeled not as convolution based algorithms but as causal physical processes. This implies that propagation of information through a neural map may act as a mechanism for achieving temporal multi-scale analysis in the auditory system. Specifically, we are interested in the effects of such a transport process on the formation and the dynamics of auditory sensory memory. Two temporal models of information propagation are discussed and compared in terms of their ability to model auditory sensory memory effects and the biological plausibility of their structure: the causal diffusion based operator (CD) and the leaky integrator cascade based operator (LINC). We show that temporal multi-scale representations achieved by both models exhibit the effects similar to those of auditory sensory memory (filtering, time delay and binding of information). As regards higher-level functions of auditory sensory memory such as change detection, the LINC operator seems to be a biologically more plausible solution for modeling temporal cortical processing.