1
|
Fletcher MD, Akis E, Verschuur CA, Perry SW. Improved tactile speech perception and noise robustness using audio-to-tactile sensory substitution with amplitude envelope expansion. Sci Rep 2024; 14:15029. [PMID: 38951556 PMCID: PMC11217272 DOI: 10.1038/s41598-024-65510-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 06/20/2024] [Indexed: 07/03/2024] Open
Abstract
Recent advances in haptic technology could allow haptic hearing aids, which convert audio to tactile stimulation, to become viable for supporting people with hearing loss. A tactile vocoder strategy for audio-to-tactile conversion, which exploits these advances, has recently shown significant promise. In this strategy, the amplitude envelope is extracted from several audio frequency bands and used to modulate the amplitude of a set of vibro-tactile tones. The vocoder strategy allows good consonant discrimination, but vowel discrimination is poor and the strategy is susceptible to background noise. In the current study, we assessed whether multi-band amplitude envelope expansion can effectively enhance critical vowel features, such as formants, and improve speech extraction from noise. In 32 participants with normal touch perception, tactile-only phoneme discrimination with and without envelope expansion was assessed both in quiet and in background noise. Envelope expansion improved performance in quiet by 10.3% for vowels and by 5.9% for consonants. In noise, envelope expansion improved overall phoneme discrimination by 9.6%, with no difference in benefit between consonants and vowels. The tactile vocoder with envelope expansion can be deployed in real-time on a compact device and could substantially improve clinical outcomes for a new generation of haptic hearing aids.
Collapse
Affiliation(s)
- Mark D Fletcher
- University of Southampton Auditory Implant Service, University of Southampton, University Road, Southampton, SO17 1BJ, UK.
- Institute of Sound and Vibration Research, University of Southampton, University Road, Southampton, SO17 1BJ, UK.
| | - Esma Akis
- University of Southampton Auditory Implant Service, University of Southampton, University Road, Southampton, SO17 1BJ, UK
- Institute of Sound and Vibration Research, University of Southampton, University Road, Southampton, SO17 1BJ, UK
| | - Carl A Verschuur
- University of Southampton Auditory Implant Service, University of Southampton, University Road, Southampton, SO17 1BJ, UK
| | - Samuel W Perry
- University of Southampton Auditory Implant Service, University of Southampton, University Road, Southampton, SO17 1BJ, UK
- Institute of Sound and Vibration Research, University of Southampton, University Road, Southampton, SO17 1BJ, UK
| |
Collapse
|
2
|
Leterme G, Guigou C, Guenser G, Bigand E, Bozorg Grayeli A. Effect of Sound Coding Strategies on Music Perception with a Cochlear Implant. J Clin Med 2022; 11:jcm11154425. [PMID: 35956042 PMCID: PMC9369156 DOI: 10.3390/jcm11154425] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 07/15/2022] [Accepted: 07/26/2022] [Indexed: 11/21/2022] Open
Abstract
The goal of this study was to evaluate the music perception of cochlear implantees with two different sound processing strategies. Methods: Twenty-one patients with unilateral or bilateral cochlear implants (Oticon Medical®) were included. A music trial evaluated emotions (sad versus happy based on tempo and/or minor versus major modes) with three tests of increasing difficulty. This was followed by a test evaluating the perception of musical dissonances (marked out of 10). A novel sound processing strategy reducing spectral distortions (CrystalisXDP, Oticon Medical) was compared to the standard strategy (main peak interleaved sampling). Each strategy was used one week before the music trial. Results: Total music score was higher with CrystalisXDP than with the standard strategy. Nine patients (21%) categorized music above the random level (>5) on test 3 only based on mode with either of the strategies. In this group, CrystalisXDP improved the performances. For dissonance detection, 17 patients (40%) scored above random level with either of the strategies. In this group, CrystalisXDP did not improve the performances. Conclusions: CrystalisXDP, which enhances spectral cues, seemed to improve the categorization of happy versus sad music. Spectral cues could participate in musical emotions in cochlear implantees and improve the quality of musical perception.
Collapse
Affiliation(s)
- Gaëlle Leterme
- Otolaryngology, Head and Neck Surgery Department, Dijon University Hospital, 21000 Dijon, France; (G.L.); (G.G.); (A.B.G.)
- ImVia Research Laboratory, Bourgogne-Franche-Comté University, 21000 Dijon, France
| | - Caroline Guigou
- Otolaryngology, Head and Neck Surgery Department, Dijon University Hospital, 21000 Dijon, France; (G.L.); (G.G.); (A.B.G.)
- ImVia Research Laboratory, Bourgogne-Franche-Comté University, 21000 Dijon, France
- Correspondence: ; Tel.: +33-615718531
| | - Geoffrey Guenser
- Otolaryngology, Head and Neck Surgery Department, Dijon University Hospital, 21000 Dijon, France; (G.L.); (G.G.); (A.B.G.)
| | - Emmanuel Bigand
- LEAD Research Laboratory, CNRS UMR 5022, Bourgogne-Franche-Comté University, 21000 Dijon, France;
| | - Alexis Bozorg Grayeli
- Otolaryngology, Head and Neck Surgery Department, Dijon University Hospital, 21000 Dijon, France; (G.L.); (G.G.); (A.B.G.)
- ImVia Research Laboratory, Bourgogne-Franche-Comté University, 21000 Dijon, France
| |
Collapse
|
3
|
Picou EM, Roberts RA, Angley G, Ricketts TA. Applying the Hearing Aid Fitting Standard to Selection for Adults. Semin Hear 2022; 43:66-78. [PMID: 35903077 PMCID: PMC9325089 DOI: 10.1055/s-0042-1748874] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022] Open
Abstract
The recent hearing aid fitting standard for adults outlines the minimum practice for audiologists fitting adult patients with hearing loss. This article focuses on three items of the standard (5, 6, and 7), which focus on the selection of unilateral/bilateral hearing aids, hearing aid style, and coupling, in addition to feature selection. The standard emphasizes that decisions around these three aspects should be recommended for a patient in an individualized manner, based on their needs assessment. For these decisions, the needs assessment might include measures of speech-in-noise ability, social network size, patient preference, and a trial period. Additional elements could include assessments of manual dexterity, binaural interference, and attitude toward hearing aids. However, there are a multitude of ways to practice clinically and still meet the items outlined in the standard. As long as the selection decisions consider individualized patient factors and are capable of meeting validated prescriptive targets, a clinician would be meeting the adult hearing aid fitting minimum standard guidance. In addition, despite the large number of past studies supporting these standards, additional, high-quality research including randomized, controlled, clinical trials are still needed to further support appropriate minimum standard recommendations.
Collapse
Affiliation(s)
- Erin M. Picou
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, Tennessee,Address for correspondence Erin M. Picou, Au.D., Ph.D. 1215 21st Avenue South, Room 8310, Nashville, TN 37232
| | - Richard A. Roberts
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Gina Angley
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Todd A. Ricketts
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, Tennessee
| |
Collapse
|
4
|
Picou EM, Rakita L, Buono GH, Moore TM. Effects of Increasing the Overall Level or Fitting Hearing Aids on Emotional Responses to Sounds. Trends Hear 2021; 25:23312165211049938. [PMID: 34866509 PMCID: PMC8825634 DOI: 10.1177/23312165211049938] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023] Open
Abstract
Adults with hearing loss demonstrate a reduced range of emotional responses to nonspeech
sounds compared to their peers with normal hearing. The purpose of this study was to
evaluate two possible strategies for addressing the effects of hearing loss on emotional
responses: (a) increasing overall level and (b) hearing aid use (with and without
nonlinear frequency compression, NFC). Twenty-three adults (mean age = 65.5 years) with
mild-to-severe sensorineural hearing loss and 17 adults (mean age = 56.2 years) with
normal hearing participated. All adults provided ratings of valence and arousal without
hearing aids in response to nonspeech sounds presented at a moderate and at a high level.
Adults with hearing loss also provided ratings while using individually fitted study
hearing aids with two settings (NFC-OFF or NFC-ON). Hearing loss and hearing aid use
impacted ratings of valence but not arousal. Listeners with hearing loss rated pleasant
sounds as less pleasant than their peers, confirming findings in the extant literature.
For both groups, increasing the overall level resulted in lower ratings of valence. For
listeners with hearing loss, the use of hearing aids (NFC-OFF) also resulted in lower
ratings of valence but to a lesser extent than increasing the overall level. Activating
NFC resulted in ratings that were similar to ratings without hearing aids (with a moderate
presentation level) but did not improve ratings to match those from the listeners with
normal hearing. These findings suggest that current interventions do not ameliorate the
effects of hearing loss on emotional responses to sound.
Collapse
Affiliation(s)
- Erin M Picou
- Department of Hearing and Speech Sciences, 12328Vanderbilt University School of Medicine, Nashville TN, USA
| | - Lori Rakita
- Department of Otolaryngology, 1866Massachusetts Ear and Eye Infirmary, Harvard Medical School, Boston, MA, USA
| | - Gabrielle H Buono
- Department of Hearing and Speech Sciences, 12328Vanderbilt University School of Medicine, Nashville TN, USA
| | | |
Collapse
|
5
|
Qi S, Chen X, Yang J, Wang X, Tian X, Huang H, Rehmann J, Kuehnel V, Guan J, Xu L. Effects of Adaptive Non-linear Frequency Compression in Hearing Aids on Mandarin Speech and Sound-Quality Perception. Front Neurosci 2021; 15:722970. [PMID: 34483833 PMCID: PMC8414550 DOI: 10.3389/fnins.2021.722970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 07/26/2021] [Indexed: 11/29/2022] Open
Abstract
Objective This study was aimed at examining the effects of an adaptive non-linear frequency compression algorithm implemented in hearing aids (i.e., SoundRecover2, or SR2) at different parameter settings and auditory acclimatization on speech and sound-quality perception in native Mandarin-speaking adult listeners with sensorineural hearing loss. Design Data consisted of participants’ unaided and aided hearing thresholds, Mandarin consonant and vowel recognition in quiet, and sentence recognition in noise, as well as sound-quality ratings through five sessions in a 12-week period with three SR2 settings (i.e., SR2 off, SR2 default, and SR2 strong). Study Sample Twenty-nine native Mandarin-speaking adults aged 37–76 years old with symmetric sloping moderate-to-profound sensorineural hearing loss were recruited. They were all fitted bilaterally with Phonak Naida V90-SP BTE hearing aids with hard ear-molds. Results The participants demonstrated a significant improvement of aided hearing in detecting high frequency sounds at 8 kHz. For consonant recognition and overall sound-quality rating, the participants performed significantly better with the SR2 default setting than the other two settings. No significant differences were found in vowel and sentence recognition among the three SR2 settings. Test session was a significant factor that contributed to the participants’ performance in all speech and sound-quality perception tests. Specifically, the participants benefited from a longer duration of hearing aid use. Conclusion Findings from this study suggested possible perceptual benefit from the adaptive non-linear frequency compression algorithm for native Mandarin-speaking adults with moderate-to-profound hearing loss. Periods of acclimatization should be taken for better performance in novel technologies in hearing aids.
Collapse
Affiliation(s)
- Shuang Qi
- Beijing Tongren Hospital, Capital Medical University, Beijing, China.,Key Laboratory of Otolaryngology-Head and Neck Surgery, Beijing Institute of Otolaryngology, Capital Medical University, Ministry of Education, Beijing, China
| | - Xueqing Chen
- Beijing Tongren Hospital, Capital Medical University, Beijing, China.,Key Laboratory of Otolaryngology-Head and Neck Surgery, Beijing Institute of Otolaryngology, Capital Medical University, Ministry of Education, Beijing, China
| | - Jing Yang
- Department of Communication Sciences and Disorders, University of Wisconsin-Milwaukee, Milwaukee, WI, United States
| | - Xianhui Wang
- Division of Communication Sciences and Disorders, Ohio University, Athens, OH, United States
| | | | | | | | | | | | - Li Xu
- Division of Communication Sciences and Disorders, Ohio University, Athens, OH, United States
| |
Collapse
|
6
|
Chen X, You Y, Yang J, Qian J, Lu Q, Kuehnel V, Rehmann J, Liu B, Xu L. Effects of nonlinear frequency compression on Mandarin speech and sound-quality perception in hearing-aid users. Int J Audiol 2020; 59:524-533. [PMID: 32441563 DOI: 10.1080/14992027.2020.1761035] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Objective: The purpose of the present study was to examine the effects of NLFC fitting in hearing aids and auditory acclimatisation on speech perception and sound-quality rating in hearing-impaired, native Mandarin-speaking adult listeners.Design: Mandarin consonant, vowel and tone recognition were tested in quiet and sentence recognition in noise (speech-shaped noise at a +5 dB signal-to-noise ratio) with NLFC-on and NLFC-off. Sound-quality ratings were collected on a 0-10 scale at each test session. A generalised linear model and correlational analyses were performed.Study sample: Thirty native Mandarin-speaking adults with moderate-to-severe sensorineural hearing loss were recruited.Results: The hearing-impaired listeners showed significantly higher accuracy with NLFC-on than with NLFC-off for consonant and sentence recognition and the recognition performance improved with both NLFC-on and off as a function of increased length of use. The satisfaction score of sound-quality ratings for different types of sounds significantly increased with NLFC-on than with NLFC-off. The speech recognition results showed moderate to strong correlation with the unaided hearing thresholds.Conclusion: For native Mandarin-speaking listeners with hearing loss, the NLFC technology provided modest but significant improvement in Mandarin fricative and sentence recognition. Subjectively, the naturalness and overall preference of sound-quality satisfaction judgement also improved with NLFC.
Collapse
Affiliation(s)
- Xueqing Chen
- Beijing Tongren Hospital, Capital Medical University, Beijing, China.,Key Laboratory of Otolaryngology - Head and Neck Surgery, Beijing Institute of Otolaryngology, Capital Medical University, Ministry of Education, Beijing, China
| | - Yanyan You
- Beijing Tongren Hospital, Capital Medical University, Beijing, China.,Key Laboratory of Otolaryngology - Head and Neck Surgery, Beijing Institute of Otolaryngology, Capital Medical University, Ministry of Education, Beijing, China
| | - Jing Yang
- Department of Communication Sciences and Disorders, University of Wisconsin - Milwaukee, Milwaukee, WI, USA
| | - Jinyu Qian
- Innovation Center Toronto, Sonova Canada, Mississauga, ON, Canada.,Department of Communicative Disorders and Sciences, University at Buffalo, State University of New York, Buffalo, NY, USA
| | - Qian Lu
- Sonova China, Shanghai, China
| | | | | | - Bo Liu
- Beijing Tongren Hospital, Capital Medical University, Beijing, China.,Key Laboratory of Otolaryngology - Head and Neck Surgery, Beijing Institute of Otolaryngology, Capital Medical University, Ministry of Education, Beijing, China
| | - Li Xu
- Division of Communication Sciences and Disorders, Ohio University, Athens, OH, USA
| |
Collapse
|
7
|
Xu L, Voss SC, Yang J, Wang X, Lu Q, Rehmann J, Kuehnel V, Qian J. Speech Perception and Sound-Quality Rating with an Adaptive Nonlinear Frequency Compression Algorithm in Mandarin-Speaking Hearing Aid Users. J Am Acad Audiol 2020; 31:590-598. [PMID: 32340058 DOI: 10.1055/s-0040-1709450] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
BACKGROUND Mandarin Chinese has a rich repertoire of high-frequency speech sounds. This may pose a remarkable challenge to hearing-impaired listeners who speak Mandarin Chinese because of their high-frequency sloping hearing loss. An adaptive nonlinear frequency compression (adaptive NLFC) algorithm has been implemented in contemporary hearing aids to alleviate the problem. PURPOSE The present study examined the performance of speech perception and sound-quality rating in Mandarin-speaking hearing-impaired listeners using hearing aids fitted with adaptive NLFC (i.e., SoundRecover2 or SR2) at different parameter settings. RESEARCH DESIGN Hearing-impaired listeners' phoneme detection thresholds, speech reception thresholds, and sound-quality ratings were collected with various SR2 settings. STUDY SAMPLE The participants included 15 Mandarin-speaking adults aged 32 to 84 years old who had symmetric sloping severe-to-profound sensorineural hearing loss. INTERVENTION The participants were fitted bilaterally with Phonak Naida V90-SP hearing aids. DATA COLLECTION AND ANALYSIS The outcome measures included phoneme detection threshold using the Mandarin Phonak Phoneme Perception test, speech reception threshold using the Mandarin hearing in noise test (M-HINT), and sound-quality ratings on human speech in quiet and noise, bird chirps, and music in quiet. For each test, five experimental settings were applied and compared: SR2-off, SR2-weak, SR2-default, SR2-strong 1, and SR2-strong 2. RESULTS The results showed that listeners performed significantly better with SR2-strong 1 and SR2-strong 2 settings than with SR2-off or SR2-weak settings for speech reception threshold and phoneme detection threshold. However, no significant improvement was observed in sound-quality ratings among different settings. CONCLUSIONS These preliminary findings suggested that the adaptive NLFC algorithm provides perceptual benefit to Mandarin-speaking people with severe-to-profound hearing loss.
Collapse
Affiliation(s)
- Li Xu
- Communication Sciences and Disorders, Ohio University, Athens, Ohio
| | - Solveig C Voss
- Innovation Centre Toronto, Sonova Canada, Inc., Mississauga, Ontario, Canada
| | - Jing Yang
- Communication Sciences and Disorders, University of Wisconsin-Milwaukee, Milwaukee, Wisconsin
| | - Xianhui Wang
- Communication Sciences and Disorders, Ohio University, Athens, Ohio
| | - Qian Lu
- Innovation Center Shanghai, Sonova China, Shanghai, China
| | | | | | - Jinyu Qian
- Innovation Centre Toronto, Sonova Canada, Inc., Mississauga, Ontario, Canada
| |
Collapse
|
8
|
In-home auditory training using audiovisual stimuli on a tablet computer: Feasibility and preliminary results. Auris Nasus Larynx 2019; 47:348-352. [PMID: 31708168 DOI: 10.1016/j.anl.2019.09.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Revised: 09/04/2019] [Accepted: 09/13/2019] [Indexed: 11/23/2022]
Abstract
OBJECTIVE To examine the feasibility and possible effects of in-home auditory training using audiovisual speech stimuli on a tablet computer for patients with hearing loss using a hearing aid (HA) or a cochlear implant (CI). METHODS In total, 11 patients with hearing loss (mean age, 60.2 ± 13.7 years) who had been using an HA or CI for more than 1 year were examined. As auditory training, the participants listened repeatedly to audiovisual speech stimuli on a tablet computer for 3 months. Speech intelligibility for trained words, untrained words, and monosyllables presented at a sound pressure level of 70 dB were assessed before and at 1, 2, and 3 months after training. RESULTS Eight out the 11 patients completed 3 months of in-home auditory training. Three of these patients withdrew from the training before completing the protocol, mainly because of "boredom from recurring simple tasks". Significant improvements in speech intelligibility were found for the trained and untrained words after the 3-month training period (p < 0.05), but no significant differences were found for monosyllables. CONCLUSION In-home auditory training using a tablet computer could help improve auditory quality of life in patients with hearing loss using an HA or CI. But the further comparative studies using other existing method will be necessary to establish the practical importance of the present method.
Collapse
|
9
|
Yang J, Qian J, Chen X, Kuehnel V, Rehmann J, von Buol A, Li Y, Ren C, Liu B, Xu L. Effects of nonlinear frequency compression on the acoustic properties and recognition of speech sounds in Mandarin Chinese. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2018; 143:1578. [PMID: 29604675 DOI: 10.1121/1.5027404] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The present study examined the change in spectral properties of Mandarin vowels and fricatives caused by nonlinear frequency compression (NLFC) used in hearing instruments and how these changes affect the perception of speech sounds in normal-hearing listeners. Speech materials, including a list of Mandarin monosyllables in the form of /dV/ (12 vowels) and /Ca/ (five fricatives), were recorded from 20 normal-hearing, native Mandarin-speaking adults (ten males and ten females). NLFC was based on Phonak SoundRecover algorithms. The speech materials were processed with six different NLFC parameter settings. Detailed acoustic analysis revealed that the high front vowel /i/ and certain compound vowels containing /i/ demonstrated positional deviation in certain processed conditions in comparison to the unprocessed condition. All five fricatives showed acoustic changes in spectral features in all processed conditions. Fourteen Mandarin-speaking, normal-hearing adult listeners performed phoneme recognition with the six NLFC processing conditions. When the cut-off frequency was set relatively low, recognition of /s/ was detrimentally affected, whereas none of the NLFC processing configurations affected the other phonemes. The discrepancy between the considerable acoustic changes and the negligible adverse effects on perceptual outcomes is partially accounted for by the phonology system and phonotactic constraints in Mandarin.
Collapse
Affiliation(s)
- Jing Yang
- Communication Sciences and Disorders, University of Central Arkansas, Conway, Arkansas 72035, USA
| | - Jinyu Qian
- Sonova China, 757 Mengzi Road, Huangpu District, Shanghai 200233, China
| | - Xueqing Chen
- Department of Otolaryngology, Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing 100005, China
| | - Volker Kuehnel
- Sonova AG, Laubisruetistrasse 28, 8712 Staefa, Switzerland
| | - Julia Rehmann
- Sonova AG, Laubisruetistrasse 28, 8712 Staefa, Switzerland
| | | | - Yulin Li
- Department of Otolaryngology, Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing 100005, China
| | - Cuncun Ren
- Department of Otolaryngology, Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing 100005, China
| | - Bo Liu
- Department of Otolaryngology, Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing 100005, China
| | - Li Xu
- Communication Sciences and Disorders, Ohio University, Athens, Ohio 45701, USA
| |
Collapse
|