The impact of temporal fine structure and signal envelope on auditory motion perception

Highly compromised auditory spatial perception in aided congenitally hearing-impaired and rapid improvement with tactile technology

Spatial understanding is a multisensory construct while hearing is the only natural sense enabling the simultaneous perception of the entire 3D space. To test whether such spatial understanding is dependent on auditory experience, we study congenitally hearing-impaired users of assistive devices. We apply an in-house technology, which, inspired by the auditory system, performs intensity-weighting to represent external spatial positions and motion on the fingertips. We see highly impaired auditory spatial capabilities for tracking moving sources, which based on the "critical periods" theory emphasizes the role of nature in sensory development. Meanwhile, for tactile and audio-tactile spatial motion perception, the hearing-impaired show performance similar to typically hearing individuals. The immediate availability of 360° external space representation through touch, despite the lack of such experience during the lifetime, points to the significant role of nurture in spatial perception development, and to its amodal character. The findings show promise toward advancing multisensory solutions for rehabilitation.

Exploring level- and spectrum-based music mixing transforms for hearing-impaired listeners

Multitrack mixing is an essential practice in modern music production. Research on automatic-mixing paradigms, however, has mostly tested samples of trained, normal hearing (NH) participants. The goal of the present study was to explore mixing paradigms for hearing-impaired (HI) listeners. In two experiments, the mixing preferences of NH and HI listeners with respect to the parameters of lead-to-accompaniment level ratio (LAR) and the low to high frequency spectral energy balance were investigated. Furthermore, preferences of transformed equalization (EQ-transform) were assessed, achieved by linearly extrapolating between the power spectrum of individual tracks and a reference spectrum. Multitrack excerpts of popular music were used as stimuli. Results from experiment 1 indicate that HI participants preferred an elevated LAR compared to NH participants but did not suggest distinct preferences regarding spectral balancing or EQ-transform. Results from experiment 2 showed that bilateral hearing aid (HA) disuse among the HI participants yielded higher LAR values, stronger weighting of higher frequencies, as well as sparser EQ-transform settings compared to a condition with HA use. Overall, these results suggest that adjusting multitrack mixes may be a valuable way for making music more accessible for HI listeners.

A review of auditory processing and cognitive change during normal ageing, and the implications for setting hearing aids for older adults

Throughout our adult lives there is a decline in peripheral hearing, auditory processing and elements of cognition that support listening ability. Audiometry provides no information about the status of auditory processing and cognition, and older adults often struggle with complex listening situations, such as speech in noise perception, even if their peripheral hearing appears normal. Hearing aids can address some aspects of peripheral hearing impairment and improve signal-to-noise ratios. However, they cannot directly enhance central processes and may introduce distortion to sound that might act to undermine listening ability. This review paper highlights the need to consider the distortion introduced by hearing aids, specifically when considering normally-ageing older adults. We focus on patients with age-related hearing loss because they represent the vast majority of the population attending audiology clinics. We believe that it is important to recognize that the combination of peripheral and central, auditory and cognitive decline make older adults some of the most complex patients seen in audiology services, so they should not be treated as "standard" despite the high prevalence of age-related hearing loss. We argue that a primary concern should be to avoid hearing aid settings that introduce distortion to speech envelope cues, which is not a new concept. The primary cause of distortion is the speed and range of change to hearing aid amplification (i.e., compression). We argue that slow-acting compression should be considered as a default for some users and that other advanced features should be reconsidered as they may also introduce distortion that some users may not be able to tolerate. We discuss how this can be incorporated into a pragmatic approach to hearing aid fitting that does not require increased loading on audiology services.

Separating the Novel Speech Sound Perception of Lexical Tone Chimeras From Their Auditory Signal Manipulations: Behavioral and Electroencephalographic Evidence

Previous research has shown the novelty of lexical-tone chimeras (artificially constructed speech sounds created by combining normal speech sounds of a given language) to native speakers of the language from which the chimera components were drawn. However, the source of such novelty remains unclear. Our goal in this study was to separate the effects of chimeric tonal novelty in Mandarin speech from the effects of auditory signal manipulations. We recruited 20 native speakers of Mandarin and constructed two sets of lexical-tone chimeras by interchanging the envelopes and fine structures of both a falling/yi⁴/and a rising/yi²/Mandarin tone through 1, 2, 3, 4, 6, 8, 16, 32, and 64 auditory filter banks. We conducted pitch-perception ability tasks via a two-alternative, forced-choice paradigm to produce behavioral (versus physiological) pitch perception data. We also obtained electroencephalographic measurements through the scalp-recorded frequency-following response (FFR). Analyses of variances and post hoc Greenhouse-Geisser procedures revealed that the differences observed in the participants' reaction times and FFR measurements were attributable primarily to chimeric novelty rather than signal manipulation effects. These findings can be useful in assessing neuroplasticity and developing speech-processing strategies.

Signal envelope and speech intelligibility differentially impact auditory motion perception

Our acoustic environment contains a plethora of complex sounds that are often in motion. To gauge approaching danger and communicate effectively, listeners need to localize and identify sounds, which includes determining sound motion. This study addresses which acoustic cues impact listeners' ability to determine sound motion. Signal envelope (ENV) cues are implicated in both sound motion tracking and stimulus intelligibility, suggesting that these processes could be competing for sound processing resources. We created auditory chimaera from speech and noise stimuli and varied the number of frequency bands, effectively manipulating speech intelligibility. Normal-hearing adults were presented with stationary or moving chimaeras and reported perceived sound motion and content. Results show that sensitivity to sound motion is not affected by speech intelligibility, but shows a clear difference for original noise and speech stimuli. Further, acoustic chimaera with speech-like ENVs which had intelligible content induced a strong bias in listeners to report sounds as stationary. Increasing stimulus intelligibility systematically increased that bias and removing intelligible content reduced it, suggesting that sound content may be prioritized over sound motion. These findings suggest that sound motion processing in the auditory system can be biased by acoustic parameters related to speech intelligibility.

Perception Mechanism of Bone-Conducted Ultrasound and Its Clinical Use

It is generally believed that ultrasound cannot be heard. However, ultrasound is audible when it is presented through bone conduction. Bone-conducted ultrasound (BCU) has unique characteristics; the most interesting is its perception in patients with profound deafness. Some patients can perceive it and discriminate speech-modulated BCU. Previous reports have suggested that BCU can be used for a hearing aid or tinnitus sound therapy. In this review, the perception of BCU at both the peripheral and central levels was investigated based on previous studies, although some of them remain controversial. We also investigated the clinical use of BCU. To develop hearing aids utilizing BCU, the encoding of speech signals into BCU has to be established. The outcomes of the reported speech modulations were evaluated. Furthermore, the suppression of tinnitus by BCU was reviewed, and the feasibility of the application of BCU to tinnitus treatment was investigated.